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ABSTRACT 


Currently, a gap exists between seminar-style shiphandling training and higher 
fidelity simulations available to the U.S. Navy Surface Warfare Officer (SWO). 
There is currently no individually accessible, low cost, intermediate level, 
interactive modality shiphandling resource that would allow SWOs to practice 
shiphandling skills without requiring instructor oversight. A student research team 
from the Naval Postgraduate School’s MOVES Institute exposed newly 
commissioned SWO students at the Surface Warfare Officers School to basic 
task scenarios designed to be complementary to material covered in their 
introductory course of instruction utilizing VSTEP’s “Ship Simulator Extremes” 
game. The students completed the treatment task trainer protocol utilizing a 
Coast Guard High Endurance Cutter model and continued with the standard 
introductory course curriculum where they utilized the fully immersive Conning 
Officer Virtual Environment (COVE) shiphandling trainer. Students were later 
evaluated in COVE on their ability to maneuver a Guided Missile Destroyer, a 
similarly configured but larger ship, underway from a San Diego pier. The 
students exposed to the game-based scenarios performed at a statistically 
significantly higher level in the categories of “Standard Commands” and “Margins 
of Safety Maintained”—two key indicators of shiphandling proficiency—following 
their normal course of instruction, than the control group. Also of note, the novice 
level students encountered difficulty in unlearning the handling characteristics of 
one model and learning a new one through the course of their instruction. Our 
findings suggest that an individually accessible, game based, shiphandling task 
trainer with ship models matching those found in the COVE and Full Mission 
Bridge would benefit newly commissioned SWOs by reinforcing classroom 
instruction. This trainer could potentially be used by SWOs of all skill levels as a 
self-study tool prior to participation in high level, fully immersive, and manpower 
intensive, naval shiphandling simulators. 
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I. INTRODUCTION 


A. PROBLEM STATEMENT 

There is currently no readily accessible, low cost, intermediate level, 
interactive modality, shiphandling resource to fill the existing gap between 
seminar-style shiphandling training and the higher fidelity simulations currently 
available to United States Navy (USN) Officers. 

This presents a significant problem vis-a-vis U.S. Naval Officers reporting 
to the fleet, especially those from commissioning sources other than the United 
States Naval Academy (USNA) and other maritime specific institutions (e.g.. 
United States Merchant Marine Academy), to whom watercraft and high quality 
shiphandling simulations are not available. Some leveling of the playing field can 
occur for the Naval Reserve Officers Training Corps (NROTC) First Class 
Midshipmen who participate in four weeks of Summer Cruise training, where, 
based on the ship’s operational schedule, they may stand watch on the Bridge as 
a Conning Officer. However, officers commissioned via Seaman to Admiral-21 
(STA-21), Officer Candidate’s School (OCS), and Direct Commissioning 
programs such as Limited Duty Officers (LDOs) and Chief Warrant Officers 
(CWOs) are not afforded these same opportunities, and as a direct result, can 
show up to their first assignment significantly behind the shiphandling learning 
curve when compared to their peers. 

Surface Warfare Officer’s School (SWOS) in Newport, Rl, has taken steps 
to ensure entry-level junior officers are exposed to common shiphandling 
evolutions prior reporting aboard their first ship through the implementation in 
December 2007 of the Surface Warfare Officer Introduction (SWOI) course. 
During this three-week course of instruction, the students are exposed to, among 
other topics, seamanship and shiphandling instruction. This shiphandling 
instruction includes four sessions in the Conning Officer Virtual Environment 
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(COVE), a fully immersive virtual environment used to simulate shiphandling 
tasks where a qualified instructor mentors the student. 

The practice of providing entry-level training to junior officers prior to 
reporting aboard their first ship is a welcome change from the practice that 
existed between 2003 and the implementation of SWOI course. Until the 
implementation of SWOI course, junior officers were provided solely with a self- 
study course immediately prior to, and in some cases after, reporting to their 
ship. The course included lectures on shiphandling physics and videos of 
shiphandling tasks, but no environment where shiphandling evolutions could be 
rehearsed or practiced. 

While the exposure of junior officers to shiphandling instruction and 
simulations in the COVE is certainly a step in the right direction, there is no real 
guarantee that the graduates of the SWOI course will be provided an opportunity 
to practice shiphandling evolutions upon reporting to their ships at the frequency 
necessary to develop competency. These limited training opportunities are a 
function of reduced operating budgets for the ships, the infrequency of evolutions 
for officers to conn the ship during (e.g., mooring to a buoy), and limited 
throughput of the Fleet Concentration Area (FCA) shiphandling simulators 
relative to the number of officers stationed there. 

A low cost, individually accessible, desktop shiphandling simulator would 
be highly beneficial to these entry-level officers, filling the existing gap between 
seminar style training and higher fidelity simulations. The benefits of such a 
simulation would not be restricted to this group alone, but could be used by the 
whole officer corps as a valuable virtual reality training aid to fill the gap in fleet 
shiphandling training resources. 

B. RESEARCH QUESTIONS 

1. Do SWOI course students who use semi-immersive, voice interactive, 
shiphandling game to practice tasks covered in classroom shiphandling theory. 
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prior to using the COVE, perform at a higher level than those not currently using 
shiphandling games? In which assessment categories will they perform better? 

2. Do SWOI students who use a semi-immersive, voice interactive, 
shiphandling game to practice standard commands covered in classroom lecture, 
prior to using the COVE, perform their standard commands at a higher level than 
those not currently using shiphandling games? 

C. HYPOTHESIS 

1. Participants will perform at a higher level in the “Aggregate Maneuver” 
score category. The Maneuver score category for this study is composed of four 
subcategories: 

• Margins of Safety Maintained 

• Use of Rudder, Propulsion, and Tugs 

• Anticipates and Evaluates Ship Responsiveness 

• Standard Commands 

2. Participants will perform at a higher level in the “Standard Commands” 
assessment subcategory in the COVE. 

3. Participants will perform at a level consistent with the control group in 
the “Use of Rudder, Propulsion, and Tugs” subcategory. We expect this result 
due to the lack of representation of verbal tugboat control in the game-based task 
trainer. 

4. Participants will perform at a higher level in the “Margins of Safety 
Maintained” subcategory. 

5. Participants will perform at a level consistent with the control group in 
the “Anticipates & Evaluates Ship Responsiveness” subcategory. We expect the 
dissimilarity between the ship models in the game-based task trainer and the 
COVE to have a negligible effect on student performance. 
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D. OTHER EXPLORATORY QUESTIONS 

Do the participants believe the game-based simulation helped prepared 
them for their use of the COVE? 

Are the participants likely to use a tool of this type in the future and/or 
recommend it to their peers? 

E. SCOPE 

The scope of our thesis focuses on answering these research and 
exploratory questions. The research team developed five hypotheses to guide 
the experiment and ultimately answer the research questions. This research 
endeavor developed four prototype task trainer scenarios using Ship Simulator 
Extremes. The team then exposed a sample population of USN ensigns over the 
period of two evenings to the task scenarios. The ensigns then completed their 
normal SWOI course, after which they were evaluated in a standardized pier side 
shiphandling scenario. After the evaluation, the team analyzed the data, 
identified trends and explained the results. Finally, the report concludes with 
recommended future work. 

F. DEFINITION OF TERMS 

• Modality: One of the main avenues of sensation (as vision) 
(Merriam-Webster, 2012). 

• Presence: defined as the subjective experience of being in one 
place or environment, even when one is physically situated in 
another (Witmer & Singer, 1998). 

• Semi-Immersive: Modalities are manipulated to induce the 
appropriate degree of presence required to achieve a task 
(Sanchez-Vives & Slater, 2005). 

• Fully Immersive: 360-degree displays and sound, with possible 
ceiling and floor displays, that affect the modalities of the 
environment change. Often incorporated with haptic modalities to 
increase presence (Sanchez-Vives & Slater, 2005). 

• Individually Accessible: Being able to be accessed and utilized by 
one individual at whatever interval that individual requires. 
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• Interactive Modality: A mode that has both input and output activity 
to influence the user to believe something exists or is experienced 
or expressed. 

• Intermediate Level: a level that is in between two extremes; in the 
application of this study- having a simulation between the low level 
seminar style environment and high level fully immersive 
environment of the COVE. 

• Standard Commands: A set of consistent commands used by naval 
vessels to direct the use of rudders and engines. 


G. MOTIVATION FOR RESEARCH 

The study began with the question of whether or not a desktop computer 
game-based simulation could help a Surface Warfare Officer (SWO) maintain 
proficiency while he or she was not on a sea tour. As SWOs, we are judged on 
our ability to competently handle a ship through a range of evolutions. While 
assigned to duties ashore, there is a paucity of opportunities to exercise this skill 
set. 

After playing and experimenting with the commercially available 
shiphandling computer games, we began to ask the question, “What if this had 
been available to us when we were brand new ensigns preparing to join the 
Fleet? Would this have made a difference in our shiphandling learning 
experience?” We believed that the answer to the question was an emphatic 
“Yes,” and polled other SWOs at NFS who concurred with us. It was at this point 
that we down selected a game to work with and began constructing our task 
trainer scenarios. 

As previously discussed, there have been significant improvements 
already in shiphandling training methodology during our brief careers. Our 
motivation towards this research topic is not to reinvent the wheel when it comes 
to naval shiphandling training, just do our small part to improve it for our fellow 
and future officers and ourselves. 
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H. BENEFITS OF STUDY 


We believe that by demonstrating that basic shiphandling skills trained in a 
desktop part task trainer will transfer to the COVE, this research has the potential 
to make shiphandling training more accessible to the individual user. By 
highlighting the capabilities of a tool of this type, we hope to provide an additional 
resource for SWOs of all levels to practice and maintain their shiphandling skills 
and ultimately move our service closer toward a comprehensive shiphandling 
training continuum. 

I. THESIS ORGANIZATION AND TABLE OF CONTENTS 

Chapter I: Introduction. This chapter defines the problem, lists the 
research questions, presents the hypothesis, and defines the scope and benefits 
of this study. 

Chapter II: Background. This chapter provides a literature review for the 
study. This review includes current literature on video game use for training, 
current USN shiphandling training opportunities, current simulations available to 
USN shiphandlers, shiphandling proficiency requirements, fleet shiphandling 
training opportunities, fleet shiphandler evaluation, and naval training 
considerations. 

Chapter III; Methodology. This chapter describes how the research team 
designed the experiment, including participants, procedures, facilities selection, 
and materials. 

Chapter IV: Results and Discussion. This chapter contains the results of 
experimentation and an interpretation of those results. 

Chapter V: Conclusions. This chapter provides an overall assessment of 
qualitative and quantitative data and recommends future work toward the design 
and implementation of a readily accessible, low cost, intermediate level, 
interactive modality, shiphandling game. 
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Appendix A: Pre-Experiment Instruction and Materials. This appendix 
contains the protocol followed in order to inbrief student participants and all 
reference materials provided to the students during the experiment. 

Appendix B: Classroom Facility Setup. This appendix describes how the 
classroom, laptop computer, and audiovisual display equipment was set up in 
support of the simulation runs. 

Appendix C: Approved IRB Protocol. This appendix contains the 
Institutional Review Board protocol for experimentation with human subjects. 
This includes approved Informed Consent forms. Demographic Survey, and Exit 
Survey. 

Appendix D: CRESST Standard Surface Force Shiphandling Assessment. 
This appendix shows the Standard Surface Force Shiphandling Assessment 
developed by the National Center for Research on Evaluation, Standards, and 
Student Testing and used by Surface Warfare Officer’s School Command for 
evaluation of students in the Conning Officer Virtual Environment (COVE). 

Appendix E: Raw Demographic Survey Data by Ouestion. This appendix 
displays the raw data in table format of the response to each question by 
participant. 

Appendix F: JMP Raw COVE Data by Participant. This appendix displays 
the raw data from the instructor evaluated final COVE session for each 
participant. 

Appendix G: Cognitive Task Analysis (CTA). This appendix displays the 
Flierarchical Task Analysis used in validating the suitability of the tasks 
developed in Ship Simulator Extremes, including a Critical Cues Inventory for 
each respective task. 

Appendix FI: CRESST Shiphandling Task Description and Grading 
Criteria. This appendix, developed by the National Center for Research on 
Evaluation, Standards, and Student Testing and used by Surface Warfare 
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Officer’s School Command, displays the description of each task in the COVE 
and associated grading thresholds. 

Appendix I: CRESST Shiphandling Tasks, Standards, and Conditions. 
This appendix, developed by the National Center for Research on Evaluation, 
Standards, and Student Testing and used by Surface Warfare Officer’s School 
Command, contains the necessary standards, tasks, and conditions to Conn a 
ship underway from a pier. 

Appendix J: Ship Simulator Extremes Scenario Construction. This appendix 
displays a systematic tutorial for constructing the four task scenarios used in this 
study. 
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II. BACKGROUND 


A. INTRODUCTION 

The military community has long embraced simulation. In 1931, Edwin 
Link patented the “Link Flight Trainer,” which he had designed to teach himself 
how to fly. The trainer went on to be produced in the thousands and was used by 
many countries during World War II to train pilots. As simulation has improved, 
more services have decided to take advantage of it as a training tool. The Air 
Force has been the biggest user of simulation in the military services with flight 
trainers. These trainers were expensive and focused on the individual pilot. The 
Army has also used simulation, like the Advanced Gunnery Training System, to 
allow tank crews to practice vital communications skills prior to live fire events 
(Morgan, 2011). With improved technology resulting in better graphics. Artificial 
Intelligence, and miniaturization, the Army and Marine Corps have begun to 
embrace simulation for infantry personnel as well (Brown, 2010). The Marine 
Corps and Army both use Virtual Battlespace 2 (VBS2) as a tool for training 
(Robson, 2009) (Bohemia International, 2006). The Navy has embraced 
simulation (Nguyen et al., 2001) with the development of Virtual Environment 
Submarine (VESUB) for submarine officers to practice surface conning, an event 
too rare to provide the desired training opportunities. The most recent naval 
simulation suite, COVE, was developed directly from experience with VESUB 
(Nguyen et al., 2001). Simulation is vital in reducing cost and enabling multiple 
units to share a single wargaming experience, whether live, virtual, or 
constructive. 

B. USE OF VIDEO GAMES FOR TRAINING 

The term “Serious Game” was introduced in the simulation industry to 
distinguish between games designed primarily for training and secondarily for 
entertainment. Examples of serious games developed for use by the U.S. Army 
include VBS2, Full Spectrum Warrior, and America’s Army. Other researchers 
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have examined the application of games for training and reported varying 
measures of effectiveness (Brown, 2010) (Stinchfield & Caldwell, 2011). 
Researchers have used measures to determine the effectiveness such as user 
experience, orientation of user, ease of use, familiarity with input devices, and 
semi vs. fully immersive environments (Green & Bavelier, 2003). 

1. Video Game Experience 

A study by Green & Bavelier (2003, Nature, p. 534) showed “action video 
game playing is capable of altering a range of visual skills.” An experiment in the 
study showed that “non- players trained on an action video game showed 
marked improvement from their pre-training abilities, thereby establishing the role 
of playing in this [visual attention] effect.” Experienced video gamers have an 
advantage using serious games for training. The experienced gamers will have 
an increased capacity of their visual attention system and possess “enhanced 
attentional capacity,” “enhance(ed) number of visual items that can be unerringly 
apprehended,” and “enhanc(ed) task-switching abilities.” Together, these 
newfound abilities could affect the speed of perception and the increased ability 
to manage several visual tasks (Green & Bavelier, 2003). 

2. Orientation Periods 

Organizations commonly hold orientation periods where they instruct new 
members in the organization’s goals, methods, and ethos. Institutions of higher 
learning implement an orientation period that allows students to become 
accustomed to the location of important buildings and living facilities. These 
locations are “tools” that the student will need to be successful at the institution 
and the orientation is provided as a form of pre-training. The training allows 
students to embrace the main purpose of attending, education, and not worry 
about how to get to around. The same is true of computer tools that a simulation 
would use for training. Trying to complete a task in a software package without 
knowing how to navigate could lead to immense frustration and derail the trainee 
from the main purpose. Unless the study is examining the ability of learning the 
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software, the basic implementations of input and manipulation of the software 
should be covered, at least to the point of basic understanding. 

3. Ease of Use and Familiarity with Input Devices 

Marc Prensky described in his book Digital Game-Based Learning that by 
the time today’s average teenager enters the workforce he or she will have 
“played over ten thousand hours of videogames.” He also describes, with a 
median age of 39, the “oldest employees [from the upper 50 percent of our 
workforce]- those between the age of 30 and 39, have been able to play, and for 
the most part have been playing, video games since junior high.” He goes on to 
say, “the newest employee hires, just out of high school or college, have never 
known a world without video games.” The new officers entering the U.S. Navy 
today have never known a world without input devices of some type (Prensky, 
2000). With thousands of hours playing video games and using a personal 
computer, common input devices, such as a mouse, will be extremely familiar to 
the average ensign. 

4. Semi-Immersive vs. Fully Immersive Environment 

A person is in a fully immersive environment when he or she is completely 
surrounded by a device or devices that affect the modalities of the environment 
change. An example is a CAVE (Cave Automatic Virtual Environment) type of 
simulation in which a person would enter a room and be surrounded by screens 
displaying the new environment, along with sound, smell, and perhaps haptic 
(touch) feedback (VRS, 2011). A semi-immersive environment would refer to one 
that would display the environment to the appropriate degree of presence 
required to achieve the task. This varies depending on the application. A flight 
trainer with a complete mock cockpit with a concave projection of only 270 
degrees is an example. The trainee is not fully immersed; however, the screen 
encompasses enough of his or her vision to be effective at training the required 
tasks (Sanchez-Vives & Slater, 2005). 
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C. CURRENT U.S. NAVY SURFACE SHIPHANDLING TRAINING 

RESOURCES 

Through our experience as Surface Warfare Officers, and from the 
knowledge gained from the Surface Warfare Officer School Command website, 
we will describe the process and application of simulation in a Surface Warfare 
Officers career. 

The U.S. Navy currently trains shiphandling through lecture and high-level 
simulation. The pipeline for surface warrior training begins at the commissioning 
source. Midshipmen will receive basic instruction in navigation and shiphandling 
at the institution they are attending. Depending on the school, midshipmen may 
pilot a small sailboat (e.g.. Laser) and have the opportunity to go on summer 
cruise aboard ships, or, in the case of Naval Academy midshipmen, on yard 
patrol craft. Following commissioning, ensigns attend a Surface Warfare Officer 
Introduction (SWOI) course developed by SWOS. The course is in Newport, Rl 
for OCS graduates and in ATG centers at FCAs for ensigns sent to the fleet from 
other commissioning sources. The SWOI course shiphandling training consists of 
a lecture followed by COVE sessions designed to initiate the students on 
standard commands, basic maneuvers, and pier work. 

Ensigns complete the SWOI course and return to their ships and continue 
shiphandling training as a member of the wardroom.The training includes utilizing 
Navigation Seamanship and Shiphandling Training (NSST) facilities established 
in FCAs. Each ship is allotted a specific number of hours for using the NSST 
resource. Within a 24-month cycle, the command has opportunities to train 
officers via the U.S. Navy’s Navigation, Seamanship, and Shiphandling Training 
(NSST) program (see CFI2-E, F). NSST provides classroom and Kongsberg V2 
system simulator instruction in the form of three main courses: Bridge Resource 
Management (BRM), Basic Ship Flandling (BSFI), and Special Evolutions Trainer 
(SET). A number of ships have also received a shipboard installed Kongsberg V1 
system to utilize for training. 
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Upon completion of division officer tours, officers will typically have no 
shiphandling training exposure until they attend the SWOS Department Head 
Course. An evolution of the original Destroyer School, the Department Head 
Course is a demanding and in-depth professional course Surface Warfare 
Officers attend in preparation for their department head tours. The intensive 24- 
week course prepares officers for duty as Engineering, Combat Systems, 
Operations, and Deck department heads on all classes of Navy ships. The 
course is divided into the Tactical Action Officer module and the SHIPTRAIN 
module, where students will receive shiphandling training. During SHIPTRAIN, 
students will attend several COVE sessions focused on improving shiphandling 
skills. SWOS has established a high standard of shiphandling expertise and all 
Department Head Course students are required to pass a rigorous shiphandling 
evaluation. 

During a department head tour, an officer’s shiphandling exposure will 
vary depending upon the type of ship they serve on. Normally, department heads 
stand watch in Combat Information Centers (CIC) and staff watch centers rather 
than the bridge. Department heads are generally the primary source of training 
for new officers as they directly supervise the first and second tour division 
officers assigned to the ship. 

After the department head tours are complete, the majority of surface 
warriors will have another gap in shiphandling experience until they report to 
SWOS for the “Command at Sea” courses. Command at Sea courses and 
curricula are designed to prepare prospective Commanding Officers (COs) and 
Executive Officers (XOs) with the tactical, operational, material management, 
and personnel skills to excel in command. The Surface Warfare Officer core 
competencies of navigation, seamanship, material readiness, and warfighting are 
reinforced through interactive lectures, seminars, simulators, case studies, and 
group discussion with subject matter experts (SMEs). 
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D. CURRENT GAME-BASED SIMULATIONS 

1. Seminar-Style Training 

Seminar training is the oldest form of shiphandling training. Typically, the 
Training Officer or Operations Officer provides a shiphandling lecture for the 
wardroom as part of the ship’s continuing training plan. Several topics are 
discussed, and although each ship will have a slightly different version, the brief 
will be very similar to the SWOI course PowerPoint presentation (see Appendix 
J). The first instinct when trying to instruct about the nuances of shiphandling is 
to take a pen out of a pocket to demonstrate the basic concepts of forces 
affecting the ship, e.g., how the ship’s stern is affected during a turn by 
controllable forces. For introductory lessons, it is enough for new officers to 
understand that the ship moves differently depending on the forces that are 
acting on it. Holistically all the senior members of a wardroom train junior officers 
through weekly training, occasionally conducting “table top” demonstrations to 
demonstrate how the ship is expected to behave during various evolutions from 
man overboard drills to underway replenishments (UNREP). Some ships have 
gone as far as having scale models made for this purpose. 

2. Kongsberg V1 and V2 

In 2004, the United States Navy commissioned bridge simulators at 
forward deployed naval forces bases. This effort represented the start of the 
USN’s NSST program. The result of the NSST project was two PC-based 
systems, the Kongsberg Version 1 and Version 2, using emulation of shipboard 
equipment (Meers, 2011). 

The Version 1 system or “VI” has been deployed on surface combatants. 
The VI system is composed of two workstation PCs installed in a half-rack, an 
instructor laptop, helm, three Thin Film Transistor (TFT) displays, and sound 
system. Shore based systems alter this configuration by using a bigger 
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42” plasma display in lieu of the TFT displays. For ships with more space there is 
an “extended” version of the V1 that adds four control panels in lieu of two 
(Meers, 2011). 

The V2 system is installed at FCAs and other central training locations. 
The system is comprised of a generic bridge mockup with 240 degrees of 
horizontal field of view from projection monitors. V2 measures approximately 15 x 
18 feet and has the following equipment: bridge instrumentation console, a 
centerline pelorus, chart table, ARPA display, and a helm console. If required an 
ECDIS display can be added near the chart table (Meers, 2011). 

Both VI and V2 are capable of supporting individual officer and bridge 
team training. Nearly all aspects of general seamanship and navy specific 
shiphandling, maneuvering, and navigational training can be effectively 
conducted (Meers, 2011). 

3. Conning Officer Virtuai Environment (COVE) 

In 1996, the Navy funded a multi disciplinary, multi institution research 
initiative called the Virtual Environment Technology for Training (VETT) program. 
The VETT program was established to provide submarine officers with a 
simulator to practice conning while surfaced. With funding from the Office of 
Naval Research (ONR) and the Naval Air Warfare Center Training Systems 
Division (NAWCTSD), MIT developed a prototype simulator to train Navy Fast 
Attack submarine OODs (Nguyen et al., 2001). 

SMEs used the prototype created the VETT initiative to develop system 
requirements for a fully developed simulator. After a list of requirements was 
developed, Nichols / Advanced Marine developed the software and hardware 
integration of what is now known as VESUB (Virtual Environment Submarine) 
Simulator. The VESUB system uses a high-resolution head mounted display 
(FIMD) to provide the trainee with a simulated 360 degree representation of the 
visual environment containing many of the required cues associated with harbor 
and channel navigation as well as accurate cultural features and varying 
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environmental conditions. Voice recognition and synthesis provide 
communications training. A Training Effectiveness Evaluation (TEE), consisting 
of a survey of 41 naval trainees of various experience levels, verified the efficacy 
of the system. The system was acquired in 1999 and distributed to five major 
submarine training facilities where it is still in use (Zeltzer & Pioch, 1996). 

VESUB’s success in training submarine officers caused NAWCTSD to 
realize its potential to train surface officers as well. Having already developed the 
VESUB simulator, NAWCTSD proposed an evolution of VESUB, developed a list 
of requirements based on its use thus far and corrected also three specific 
VESUB limitations that needed to be addressed in a next generation simulator: 
instructor intensiveness, high cost, and “transfer of VE-based training to the real 
world task” (Nguyen et al., 2001). This improved shiphandling trainer would be 
known as Conning Officer Virtual Environment (COVE). 

COVE was designed to correct the three main limitations of VESUB. 
Development focused on reducing instructor involvement and increasing 
capability of supporting the following tasks; basic navigation, shiphandling, 
seamanship, harbor and strait transits, contact management, pier and tug work, 
DIVTACs, stationing, plane guard, signals, flags, lights, and day shapes. COVE 
is also capable of supporting the following special evolutions: anchoring, mooring 
to a buoy, towing, UNREP, Man Overboard, and Engineering Casualties 
(NAWCTSD, 2010). 

In addition to supporting ships evolutions COVE can be used for tactical 
operations training such as tactical maneuvering (shouldering, HVU Escort, 
VBSS approach, etc.), Anti-Terrorism/Force Protection (Anchored, Moored, and 
Underway), small vessel detect to engage (threat determination, escalation of 
force, deterrence, etc.), weapons management (M-60, .50 cal, 25mm, 5 inch), 
multi-ship coordinated tactics, techniques, and procedures (TTPs) (NAWCTSD, 
2010 ). 
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Due to its purpose built scalability, COVE can train for individuals, bridge 
teams, or even multiple ships interacting together. COVE integrates several 
technologies such as the Integrated Technology Head Mounted Display featuring 
a 360-degree display, tactical and emulated hardware, and speech recognition 
(NAWCTSD, 2010). 

Several FCAs have COVEs installed, SWOS in Newport, Rl has twelve 
COVE 1 stations, six COVE 3 stations, a Full Mission Bridge simulator, and a 
reconfigurable LCS-1 or LCS-2 Full Mission Bridge simulator (NAWCTSD, 2010). 
Two stand-alone LCS-1 and LCS-2 simulators are in LCS shore based training 
facility, San Diego. For the training of pre-commissioning units, there are COVE 1 
simulators provided at shipyards in Bath, ME and Pascagoula, MS. NSWC 
Panama City has installed a COVE RMV/USV Launch and Recovery Trainer. 
COVE 1 has also been used in some NROTC units for Midshipman Training. 
Variants of COVE are in use by the U.S. Navy Submarine Fleet, U.S. Coast 
Guard, and U.S. Army (NAWCTSD, 2010). 

The COVE software package incorporates 56 harbor databases of 
strategic naval ports and operational areas around the world. 27 high-fidelity 
hydrodynamic ship models of USN warships and various ships and boats of 
tactical significance are also provided. In addition to USN and threat models, 36 
low fidelity models of common ship traffic, target ships, aircraft and personnel 
models are available. Models are capable of displaying fire, smoke, weapons, 
and damage effects. The COVE hardware package depends on the required 
configuration (NAWCTSD, 2010). 

4. Full Mission Bridge 

The Full Mission Bridge (FMB) is an expansion of COVE that can train an 
entire watch team instead of focusing on a single officer. The FMB is a mock 
bridge, similar to Kongsberg V2, which is made up in the same general 
configuration as a bridge on a ship having a bridge instrumentation console, a 
centerline pelorus, chart table, ARPA display, and a helm console. COVE FMB is 
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different from V2 in that it is displayed in a CAVE with the “bridge” being placed 
in the center giving the proper perspective. Trainees can move freely from bridge 
wing to bridge wing without a change in perspective. The trainer is capable of the 
full range of COVE scenarios and is equipped with virtual binoculars to simulate 
binoculars used by bridge watchstanders. The only existing FMB is located at 
SWOS in Newport, Rl (Surface Warfare Officer School Command, 2011). 

E. SURFACE FORCE TRAINING MANUAL SHIPHANDLING TRAINING 

PROFICIENCY REQUIREMENTS 

Commander Naval Surface Forces (COMNAVSURFOR) directs 
shiphandling training via the Surface Force Training Manual 
(SURFORTRAMAN). The common mission area Navigation Certification Criteria 
requires a ship to maintain a Continuous Certification Requirement (CCR) called 
Bridge Resource Management (BRM). In order to accomplish this requirement 
the command must attend a 40-hour BRM course given at NSST locations in 
FCAs every 24 months. In addition to BRM, each ship is required to complete 28 
hours of special evolutions training (SET) and attend a basic ship handling (BSFI) 
course every 24 months (Commander, COMNAVSURFOR INSTRUCTION 
3505.1 A, 2010). 

F. FLEET SHIPHANDLING TRAINING OPPORTUNITIES 

To accomplish the requirements directed by COMNAVSURFOR, each 
commissioned U.S. Navy ship is allotted time in FCA NSST trainers (Kongsberg 
VI, V2, and Bridge Wing trainer; depending on location). Every ship has an 
annual allotment of up to 100 hours to include one formal course, BRM or BSH, 
plus up to an additional 32 hours of SET, (Commander, COMNAVSURFOR 
INSTRUCTION 3505.1 A, 2010). 

For the BRM course, ships are required to send three watch teams. Each 
team must consist of an Officer of the Deck and Conning Officer, plus a senior 
observer such as the CO, XO, or Senior Watch Officer. The ship may send junior 
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bridge watch slanders for training as well up to a maximum of ten total students 
(Commander, COMNAVSURFOR INSTRUCTION 3505.1 A, 2010). 

Ships can request one BSH course every 24 months; however, the ship 
must be greater than 6 months from completing a BRM and 6 months from the 
end of periodicity of the 24-month BRM requirement. The BSH course is a five 
day, 40 hour, simulator intensive course of instruction, designed for the newly 
commissioned officers and bridge watch slanders. The course provides a 
valuable opportunity for elementary evolutions training, including classroom 
lecture and instruction, but focusing on and weighted towards simulator time. 
During the course students address forces on the ship, basic Rules of the Road, 
standard commands, tugs, getting underway, making a landing, transiting a 
channel, underway replenishment, man overboard, anchoring and tactical 
maneuvers. Class size is limited to six students (Commander, 
COMNAVSURFOR INSTRUCTION 3505.1A, 2010). 

Special Evolution Training gives ships the opportunity to train in any 
evolution(s) the commanding officer believes will benefit his or her watch 
slanders. Ships decide what combination of special evolutions topics and 
scenarios to schedule. The special evolutions modules are presented in four- 
hour sessions (approximately 45 minutes of instruction followed by three plus 
hours in the simulator) (Commander, COMNAVSURFOR INSTRUCTION 
3505.1 A, 2010). 

1. Falling through the Cracks 

A key differentiator between the surface navy and naval aviation 
communities is how the officers are prepared to enter the fleet and where the 
focus of preparation sits. New officers in the former will report to the fleet with 
some conceptual knowledge and limited time in the simulator while the latter 
report to their units knowing how to fly and ready to do so. Typically, without as 
much experience as their seniors, these pilots are still certified to have the skills. 
Aviators are the center of focus for preparation in their community as, holding 
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aviation platform type constant; they can still accomplish their mission 
irrespective of the “side number” of the aircraft they fly. In the case of SWOs, it is 
and always must be “the ship” that is the focus of preparation. “The ship” 
performs the mission, “the ship” must be ready for tasking, thus the schedule of 
all crew members, officer and enlisted, revolves around “the ship.” This holistic 
team preparation concept must be grasped if one is to move forward in 
understanding how a newly reporting SWO integrates with their career 
assignment timing into this picture. 

A ship adheres to a 27-month timeline, referred to as the Fleet Response 
Training Plan (FRTP), to prepare for deployment. It is within this framework that a 
ship conducts training, scheduled repairs, shipyard maintenance, and fleet 
exercises in order to be ready for the next deployment. Figure 1 graphically 
represents a generic ship FRTP timeline. A newly commissioned SWO ensign, 
upon reporting to their first ship will generally complete a tour of 30 months 
before rotating to their next afloat assignment. The timelines of the FRTP and a 
SWO ensign’s reporting and detaching are independent of each other. This could 
place the new officer, ideally, onboard as the ship prepares for a deployment, 
thereby ensuring they are exposed to all of the training opportunities previously 
described. Conversely, this new officer could report after the ship has already 
completed all of their allotted simulator time. 
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The 27-month FRTP cycle and the 24-month NSST time allotment roughly 
coincide. A command usually attends the BRM course prior to the basic phase 
and the BSH course a year later, after the ship returns from deployment. If an 
officer were to report to the ship after completion of advanced phase 
qualifications, or at the beginning of a deployment, it is likely that the ship has 
already expended its time allotted for BRM. In the year the officer is onboard he 
or she will be trained during watchstanding evolutions at sea, with perhaps only 
one or two pier side shiphandling evolutions. 

As the cycle progresses, new officers will arrive and begin to train 
onboard. When the ship returns and the training cycle recommences, the ship 
will select who will attend the upcoming BSH. In order to take the most capable 
withstanders on the next deployment, the command will typically choose the 
officers who most recently reported. By this time in the training cycle the officer 
that reported just after completion of the last training cycle will likely be a 
qualified Officer of the Deck (OOD) and the command may not see the benefit in 
his attending BSH as he or she is close to transferring before or during the next 
deployment. 

Though much effort has been expended in the attempt to ensure that each 
ship has fair and equitable access to simulation training facilities, the fact 
remains that they are a constrained resource in any given FCA. The possibility 
exists, as in the case of the officer reporting after all pre-deployment ship training 
has concluded, that individual officers may not receive as much NSST simulator 
time as their peers. The officer that has less NSST simulation time is at a 
disadvantage when compared to officers trained in BSH or BRM. The NSST BSH 
and BRM courses are more capable training environments due to the smaller 
class sizes and much larger body of knowledge of the highly experienced (most 
are former ship commanders) instructors. It is possible that an officer will depart 
from his first ship with his SWO qualification having attended only the SWOI 
course introduction to COVE and the SWOS Advanced Shiphandling and Tactics 
(ASAT) course. 
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While the hypothetical example given above is certainly the exception to 
the rule, it is worth illustrating that under the right circumstances, with respect to 
report date and FRTP phase, an officer could miss most if not all allotted FCA 
shiphandling simulator opportunities with no checks in place across the surface 
force to alert command leadership. If such checks existed, they would likely be 
tracked locally at the individual command level. 

G. EVALUATION OF SHIPHANDLING EVOLUTIONS 

Evaluations of shiphandling evolutions are conducted during a ship’s 
preparation for deployment. These evaluations are part of a group of ship wide 
inspections called ULTRA (Unit Level TRAining). While a majority of the 
evaluations involve seamanship, the majority of shiphandling evaluation is done 
in the Navigation (Tab M/ MOB-N) and Seamanship (Tab N/ MOB-S) mission 
areas, which are typically reviewed by the Afloat Training Group (ATG) during 
ULTRA-C (Commander, SURFACE FORCE TRAINING MANUAL, 2007) 

ATG is an organization that exists to support DESRONs (Destroyer 
Squadrons), surface major commands, and individual ships in the preparation 
and execution of training and evaluation events (Commander, SURFACE 
FORCE TRAINING MANUAL, 2007). 

During the course of ULTRA-C, ATG will assess how well the ship has 
completed CCRs. Once the ship has met all of the OCRs to ATG’s satisfaction, 
the organization will inform the ship’s DESRON or Immediate Superior in 
Command (ISIC) that it is ready to deploy. If there are any discrepancies in the 
evaluations, the ship will receive remediation to meet standards (Commander, 
SURFACE FORCE TRAINING MANUAL, 2007). 

H. TRAINING CONSIDERATIONS 

In the Navigation portion of ULTRA-C, ATG will examine the proper 
completion of the NSST BRM course and the completion of the SURFOR 
prescribed SET hours. NSST resources are limited and each ship must be ready 
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to take advantage of the time they are allotted in the trainer. The ship does not 
get another opportunity in the trainer once the allotted hours are used. To make 
the best of the simulation training opportunity the ships senior department head 
or “Senior Watch Officer” will determine who will form the watch sections 
underway. Typically the men and women that form these watch sections will 
attend the trainer and complete the BRM requirement. Nominally, all officers will 
utilize the SET hours as organized by the Senior Watch Officer. The men and 
woman attending NSST training probably have not conducted the evolutions they 
will perform in the trainer since last deployment or perhaps never have in the 
case of a newly commissioned officer. Depending on when an officer reports to a 
ship, and the need to train qualified watchstanders, he or she may never get 
simulation training with the ship prior to qualification. Practicing the evolutions 
with a game based trainer onboard ship prior to high-level simulation training 
would be ideal in order to maximize the limited amount of training available. 
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III. METHODOLOGY 


A. INTRODUCTION 

This study uses a quasi-experimental design (Mitchell & Jolley, 2007) 
based on the simple experiment. The treatment design utilizes a test group and 
control group with the test group receiving a treatment. The design differs from 
the simple experiment in that the researchers used data from a previous study as 
the control group data due to time, resources, and SWO Introduction class size 
restraints. 

The research team was able to make three visits to SWOSCOLCOM, 
Newport, Rl in order to conduct a preliminary fact finding visit and recruit 
participants from two SWOI classes. The design focused on giving student 
volunteers a treatment and then measuring its effect on their total learning 
experience. 

The researchers asked SWOI student participants to sign up for a time 
after class in which to participate in the treatment. The times were staggered 
based on the 45-minute length of the treatment. The participants would be 
required to complete two 45-minute treatment sessions broken down into three 
parts, introduction, familiarization, and task scenario. 

1. Tasks 

Participants performed the role of conning officer, or conn, aboard a ship. 
The conn gives orders to control ship’s engines, rudders, and ground tackle 
(Barber, 2005). The participants familiarized themselves with the ship’s handling 
characteristics by issuing orders and assessing responses of the ship in a game. 
The participants used available controllable forces to get the ship underway from 
a pier and make a landing on a different pier further down the channel. 
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2. Simulator: Choosing a Desktop Virtual Environment 

The researcher team searched extensively for available COTS game 
based shiphandling software to be used for this study. After compiling a list of 
candidates, the team decided to evaluate three games that fit best the study: 
Ship Simulator Extremes by VSTEP, Ports of Call Simulator 3D II, and Virtual 
Sailor. The criteria for selecting the game were ease of use, graphics, 
manipulation of camera viewpoint, robust mission editor, apparent physics, 
environmental effects, and variety of ports available for use. Based upon these 
criteria. Ship Simulator Extremes by VSTEP stood out against the rest due to 
above average scores in all criteria and having an extremely comprehensive 
mission editor required to create customized scenarios for participants. 

3. Scenarios 

Researchers used two types of scenarios in the study, a familiarization 
scenario and a task scenario. They chose a section of the New York City harbor 
map which was relatively void of distracting or confusing landmarks. In the 
familiarization scenario, the ship model started in the middle of the channel 
during mid-day, with the rudder centerline, the engines generating no thrust and 
no environmental forces affecting the ship. The scenario provided participants an 
opportunity to practice controlling the movement of the ship using standard 
commands and to familiarize themselves with the available visual range of the 
third person camera, controlled by wireless mouse. A researcher, acting as the 
helmsman, converted the verbal commands given by the participant to orders to 
the software. The familiarization scenario for the second day of treatment was 
the same with the time of day advanced to civil twilight in order to slightly change 
the scenario aesthetics and keep the participant challenged. 

In task scenario one, given on the first day of treatment immediately after 
the familiarization scenario, participants started with a Coast Guard High 
Endurance Cutter (WHEC) moored to a long straight pier with no obstructions. 
The participant began by reading written instructions in-scenario called “Captains 
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Orders” to maneuver the ship off the pier and proceed to a berth further down the 
channel. Once the participant maneuvered the ship to within approximately 100 ft 
from the ordered pier and below 1-knot speed over ground (SOG) he participant 
would order the helmsman-researcher to “Put over all lines.” When Line 2 was 
fast to the bollard, the scenario would end. During the second treatment session, 
which occurred after the second familiarization scenario, the student completed 
task scenario two. The scenario time of day and environmental forces are the 
same as scenario one. In scenario two, the captain’s order instructed the 
participant to pull into a berth after transiting the channel a short distance. The 
assigned berth had a ship moored aft and on the inboard positions of the berths 
on the adjacent pier. This required the participant to maneuver between two 
moored ships and then attempt a landing on the limited area ahead of the ship 
moored on the participant’s starboard side. 

B. PARTICIPANTS 

1. Recruiting 

The researchers coordinated with SWOS N72 staff and SWOI instructors 
to present the opportunity to volunteer for the study to the students. The research 
team spoke to the students, absent of instructor staff, in a classroom with the aid 
of a PowerPoint presentation. At the end of the presentation, the research team 
provided sign-up sheets the students could fill out if they wanted to participate. 

2. Randomization 

There was no group randomization since all received part the treatment 
and the treatment was the same for every participant. The third visit by the 
research team resulted in the need to use randomization to choose participants 
due to having more volunteers than time allowed. In that case, a random sample 
of seven participants was selected using the random numbers method (Mitchell & 
Jolley, 2007; Peters, Bratt, & Kirschenbaum, 2011). 
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C. AVAILABILITY OF CONTROL POPULATION DATA SET 

The research team used control group data provided by a study of an 
Intelligent Tutoring System combined with the COVE, titled “Automated Support 
for Learning in Simulation: Intelligent Tutoring of Shiphandling” (Peters, Bratt, & 
Kirschenbaum, 2011), in order to maximize the treatment group with the limited 
number of student volunteers the research team had available. The COVE ITS 
study utilized similar SWOI participants receiving the standard course of 
instruction as their control group. Instructors utilized the CRESST Standard 
Surface Force Shiphandling Assessment to collect performance data to evaluate 
the control group participants on their ability to conn a DDG 51 COVE model 
underway from a San Diego Naval Station pier, with no active environmental 
forces.. Ten students participated in the control group for this study. 

D. PROCEDURES 

1. Before the Treatment 

Approximately 60 minutes prior to the first treatment scenario, the 
research team arrived to set up the equipment. The researchers used a 
commercially available shiphandling game console input device to apply 
standard commands announced by the participant as he or she observed the 
simulation on an overhead projector. A Dell laptop computer was connected by 
VGA cable to a projector installed in the classroom. 

Upon arrival, the individual participants completed the demographic 
survey and signed the consent form. The researchers pointed out that the dry 
erase board contained key elements of the SWOI shiphandling and standard 
commands lecture as a “kneeboard” guide by the research team. The dry erase 
board also contained the syntactic breakdown of standard engine and rudder 
commands. The researchers briefed the students on the handling characteristics 
of the Ship Simulator Extremes WHEC to include; length, beam, engine, shaft, 
and propeller configuration. 
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The students were directed to the dry erase board where a diagram, 
adapted from their classroom lectures, illustrated the basic effects of prop walk 
and position of rudders and engines to twist a ship (e.g., for a port twist: left full 
rudder, starboard engine ahead, and port engine back.) Finally, the students 
were informed that there would be a 10-knot harbor speed restriction for 
scenarios 2 and 4. 

The students received printed copies of the SWOS shiphandling and 
standard commands lectures, a copy of “Naval Shiphandlers Guide” (Barber, 
2005) identical to the one issued by SWOS, and a SWOS COVE standard 
commands reference sheet to refer to if needed. 

A researcher demonstrated how the mouse would allow them to pan the 
camera around the ship model and zoom the camera in and out on the WHEC. 
The researcher, acting as helmsman / lee helm, told the student to request a 
“center view” if required due to the ease of centering by a preprogrammed control 
console button. If the participant had no further questions, the research team 
started the scenario. For the second day’s treatment, the researchers began with 
pointing out the reference material location and re-familiarizing the participants 
with mouse and treatment specific commands. 

2. During the Treatment 

Treatment group participants performed the role of the conning officer 
aboard a WFIEC in port getting underway from and mooring to a pier. The 
treatment group participants issued standard commands to a researcher serving 
as the helmsman / lee helmsman. Each participant reported at a specific time for 
the treatment. The treatments were staggered 45 minutes apart. 

Treatment scenario one provided the student with a fifteen-minute free 
play scenario in which they could give any standard command they wanted. 
Upon completion of fifteen minutes, the scenario would automatically end. The 
research team then asked if he or she had any further questions and allowed a 
five-minute break. The research team would then begin the task scenario. The 
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task scenario gave participants a ship-maneuvering task, which they would 
attempt to use their knowledge from classroom presentations to accomplish. In 
the study’s first task scenario the task was getting the ship underway from and 
then mooring to a pier. When the participant had accomplished the task, run out 
of time, or expressed their desire to stop, the treatment would end and the 
participant would depart. 

In the second 45-minute session, the researchers started the second 
familiarization phase using a free play scenario similar to the first day’s treatment 
The time of day and starting position of the ship had been adjusted to prevent 
participant complacency. After completion of the familiarization scenario, 
researchers asked the participant whether he or she had any questions and 
allowed a five-minute break. Then research team would begin the second task 
scenario. The second task scenario was more challenging than the first. The 
participant attempted to maneuver the ship underway from a relatively simple 
mooring and make a landing in a more complex pier layout. The assigned berth 
had a ship moored aft and on the inboard positions of the berths on the adjacent 
pier. This resulted in the participant having to maneuver between two moored 
ships and then attempt a landing on the limited area ahead of the ship moored on 
the participant’s starboard side. When the participant had accomplished the task, 
run out of time, or expressed their desire to stop, the treatment would end and 
the participant would depart. 

3. After the Treatment 

The researchers reminded the participant of the time for the next session 
or thanked for their willingness to participate. The researchers requested the 
participant complete an online survey after graduation from SWOI, at their 
convenience, by February 2012. 

4. Researcher Interaction During Treatments 

The research team went to great lengths to minimize any undue coaching 

interaction from the researchers to the participants during the treatments. Some 
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interaction was unavoidable, to include clarification of the “Captain’s Orders,” 
clarifications of the illustrations on the dry erase board, and questions asked by 
the participants about standard command pronunciation. The helmsman- 
researcher would respond to commands that were not in accordance with SWOS 
instruction by saying, “Orders to the Helm” as would occur on a ship. 

5. SWOS COVE Training Sessions 

Post treatment, the participants resumed the SWOI course of instruction 
consisting which included four instructed COVE sessions. The instructed COVE 
sessions introduce new officers to COVE and shiphandling in general. COVE 
sessions one through four consist of rudder and engine familiarization and 
maneuvering, man overboard procedures, UNREP, and maneuvering underway 
from and making a pier landing, respectively. 

6. Final COVE Evaluation Session 

Each volunteer participated in an evaluation scenario given by a qualified 
SWOS COVE instructor. The evaluation scenario was the same one used in the 
COVE ITS study, and under the same conditions, to reliably compare the control 
group data from that study. 

The instructor conducting the evaluation was qualified to instruct and 
evaluate students in the COVE. The instructor evaluated the participants on their 
ability to conn a DDG 51 COVE model underway from a San Diego Naval Station 
pier, with no active environmental forces. Instructors utilized the Center for 
Research on Evaluation, Standards, and Student Testing (CRESST) Standard 
Surface Force Shiphandling Assessment to collect the same “Maneuver” 
category data as the COVE ITS control group. Eleven students participated in the 
treatment group for this study. 
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E. MATERIALS 

1. Hardware and Software 

Laptop computer (Dell Model PP28L, XPS M1530, Windows Vista 
Ultimate), VRinsight ship control console input device (www.vrinsight.com), 
Computer speakers (Dell), and Wireless three-button mouse (Microsoft), Ship 
Simulator Extremes (Build 1066 - Version 1.3.5). Please note that the subjects 
had no contact with the ship control console, so that future researchers might run 
the experiment without it. However, this is not recommended, as the console 
provided a more realistic response and is easier for the helmsman to control. 

2. Data Collection 

The same qualified instructor generated the data for all experimental 
group participants. He used the CRESST Standard Surface Force Shiphandling 
Assessment utilizing the “Maneuver” category employed in the COVE ITS study. 

3. Exit Survey 

The research team created an exit survey by and implemented through 
SurveyMonkey using the Naval Postgraduate School Research account. 
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IV. RESULTS AND DISCUSSION 


A. DEMOGRAPHICS 

Participants in this experiment were volunteers from the SWOI course. 
Eleven volunteers, serving as the treatment group, began and completed the 
study. Five of eleven completed the voluntary exit survey. Of the eleven 
volunteers, all were ensigns with less than one-month service as an officer. Two 
of the volunteers were female; nine were male. The age of the volunteers ranged 
between 22 years to 28. The average age was 23.4 with a standard deviation of 
1.776 years. 


Category 

Specific Category 

Total 


Yes 

5 

Do you play video games on computers (e.g., PC/MAC)? 

No 

6 

Have you ever played simulation video games on your 

Yes 

6 

computer? 

No 

5 

If the answer to the previous question is "Yes," have any 

Yes 

0 

of the computer simulations been related to naval or 

No 

6 

commercial shipping? 

N/A 

5 

If you have played video games on your computer as 
described in question 3, what amount of time would you 

N/A 

11 

say you have contributed to the game in the last six 

months? (e.g. hours, days, weeks, months, etc.) 



What amount of time have you spent playing simulations 

None 

7 

other than those related to question 3? (e.g., hours. 

Hours 

2 

days, weeks, months, etc.) 

Months 

2 

What amount of time have you spent playing any video 

None 

6 

game on a computer in the last six months (non-console. 

1-10 hours 

2 

Xbox, PS3)? 

> 10 hours 

3 

What level of shiphandling experience do you have (e.g.. 

None 

9 

recreational, military, commercial)? 

Recreational 

2 

Do you have sailing experience? 

Yes 

2 

No 

9 


Table 1. Demographic data by survey question 
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Table 1 shows the summary totals for each demographic category of the 
test group. Demographic data for the control group is available for reference in 
“Automated Support for Learning in Simulation: Intelligent Tutoring in 
Shiphandling” (Peters, Bratt, & Kirschenbaum, 2011) and is similar to test group 
data. 

B. ANALYSIS OF FINAL COVE EVALUATION 

1. Analysis of Margins of Safety Maintained Scores 

The SWOS instructor assessed the study participants on their ability to 
maintain proper margins of safety while maneuvering through their final COVE 
evaluation session. The assessment criteria and definition for proper margin of 
safety utilized for both the test and control groups are contained in Appendix H, 
Figure 35. Table 2 displays the descriptive statistics for both groups. 



Marqins of Safety Maintained 


n 

Mean 

Standard Deviation 

Standard Error 

Lower 95% Cl 

Upper 95% Cl 

Treatment 

Control 

11 

17.273 

4.671 

1.408 

14.135 

20.411 

10 

14.000 

9.660 

3.055 

8.013 

19.987 


Table 2. Treatment vs. Control Descriptive Statistics for Margins of Safety 

Maintained 


Figure 2 displays the distribution of treatment group scores in histogram 
form. Eight participants performed at the “Meets Standards” level, three 
participants performed at the “Needs Improvement” level. Individual participant 
data for the control group was not available at the time of our study due to IRB 
restrictions on the data. 
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Figure 2. Histogram of Treatment Margins of Safety Maintained Scores 


Table 3 displays the results of a One-Tailed Z-Test and Wilcoxon Signed 
Rank Test performed on the treatment data after fitting the distribution in JMP. 
Researchers utilized control set mean and standard deviation as the 
hypothesized mean and true standard deviation. Treatment set data displayed 
statistical significance to the 0.0039 level, suggesting improved student 
performance in the “Margins of Safety Maintained” scoring category in the final 
COVE evaluation session. 


Test Mean 


Hypothesized Value 
Actual Estimate 
DF 

Std Dev 
Sigma given 


Test Statistic 
Prob > |z| 
Prob > z 
Prob < z 


14 

17.2727 

10 

4.67099 

9.66 


z Test 

Signed-Rank 

1.1236 

27.0000 

0.2612 

0.0078* 

0.1306 

0.0039* 

0.8694 

0.9961 


Table 3. JMP Output for Margins of Safety Maintained Scores One-Tailed 

Z-Test and Wilcoxon Signed Rank Test 


Figure 3 shows the comparative means with associated whisker plots 
representing the 95% confidence intervals for the treatment and control groups. 
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Figure 3. Comparative Means Whisker Plot of Margins of Safety Maintained 
Mean Scores Treatment versus Control with 95% Cl 


2. Analysis of Use of Rudders, Propulsion, and Tugs Scores 

The SWOS instructor assessed study participants on their ability to 
employ correctly the ship’s rudders (steering) and propulsion (thrust control) 
during their final COVE evaluation session. Additionally, they had a tractor tug 
available for lateral, forward diagonal and aft-diagonal movement. The 
assessment criteria and definition for proper use of rudders, propulsion, and tugs 
utilized for both the test and control groups is contained in Appendix H, Figure 
35. Table 4 displays the descriptive statistics for both groups. 



Use of Rudder, Propulsion, and Tuqs 

Treatment 

Control 

n 

Mean 

Standard Deviation 

Standard Error 

Lower 95% Cl 

Upper 95% Cl 

11 

45.455 

10.113 

3.049 

38.661 

52.249 

10 

45.000 

15.810 

5.000 

40.000 

50.000 


Table 4. Treatment vs. Control Descriptive Statistics for Use of Rudder, 

Propulsion, and Tugs 


Figure 4 presents the distribution of treatment group scores in histogram 
form. Nine participants performed at the “Meets Standards” level, two participants 
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performed at the “Needs Improvement” level. Individual participant data for the 
control group was not available due to IRB restrictions on the data. 



Figure 4. Histogram of Treatment Use of Rudder, Propulsion, 

and Tugs Scores 

Table 5 displays the results of a One-Tailed Z-Test and Wilcoxon Signed 
Rank Test performed on the treatment data after fitting the distribution in JMP. 
Researchers utilized control set mean and standard deviation as the 
hypothesized mean and true standard deviation. Treatment set data displayed no 
statistical significance, suggesting no discernible effect on student performance 
in COVE through exposure to the game based protocol. 


Test Mean 


Hypothesized Value 


45 

Actual Estimate 


45.4545 

DF 


10 

Std Dev 


10.113 

Sigma given 


15.81 


z Test 

Signed-Rank 

Test Statistic 

0.0954 

12.0000 

Prob > |z| 

0.9240 

0.3408 

Prob > z 

0.4620 

0.1704 

Prob < z 

0.5380 

0.8296 


Table 5. JMP Output for Use of Rudder, Propulsion, and Tugs Scores One-Tailed 

Z-Test and Wilcoxon Signed Rank Test 
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Figure 5 shows the comparative means with associated whisker plots 
representing the 95% confidence intervals for the treatment and control groups 
are in. 


Use of Rudder, Propulsion, 
and Tugs 



0 

Treatment Control 

Figure 5. Comparative Whisker Plot of Use of Rudder, Propulsion, and Tugs 
Mean Scores Treatment versus Control with 95% Cl 

3. Analysis of Anticipates and Evaluates Ship Responsiveness 
Scores 

The SWOS instructor assessed study participants on their ability to 
anticipate and evaluate the ship’s responsiveness to control inputs during their 
final COVE evaluation session. The assessment criteria and definition for proper 
anticipation and evaluation of ship responsiveness for both the test and control 
groups is contained in Appendix FI, Figure 36. Table 6 displays the descriptive 
statistics for both groups. 



Anticipates and Evaluates Ship Responsiveness 

Treatment 

Control 

n 

Mean 

Standard Deviation 

Standard Error 

Lower 95% Cl 

Upper 95% Cl 

11 

11.818 

4.045 

1.220 

9.101 

14.536 

10 

16.000 

8.430 

2.666 

13.334 

18.666 


Table 6. Treatment vs. Control Descriptive Statistics for Anticipates and 

Evaluates Ship Responsiveness 
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Figure 6 displays the distribution of treatment group scores in histogram 
form. Two participants performed at the “Meets Standards” level, nine 
participants performed at the “Needs Improvement” level. Individual participant 
data for the control group was not available due to IRB restrictions on the data. 



Figure 6. Flistogram of Treatment Anticipates and Evaluates Ship 

Responsiveness Scores 

Table 7 displays the results of a One-Tailed Z-Test and Wilcoxon Signed 
Rank Test performed on the treatment data after fitting the distribution in JMP. 
Researchers utilized control set mean and standard deviation as the 
hypothesized mean and true standard deviation. Treatment set data displayed a 
statistically significantly lower value than the control to the 0.05 and 0.002 level 
for the One-Tailed Z-Test and Wilcoxon Signed Rank Test respectively. This 
suggests that the students exposed to the game based task trainer scenarios 
performed at a lower level than the control group in the final COVE evaluation. 
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Test Mean 


Hypothesized Value 


16 

Actual Estimate 


11.8182 

DF 


10 

Std Dev 


4.0452 

Sigma given 


8.43 


z Test 

Signed-Rank 

Test Statistic 

-1.6453 

-30.0000 

Prob > |z| 

0.0999 

0.0039* 

Prob > z 

0.9500 

0.9980 

Prob < z 

0.0500* 

0.0020* 


Table 7. JMP Output for Anticipates and Evaluates Ship Responsiveness Scores 

One-Tailed Z-Test and Wilcoxon Signed Rank Test 


This result was unexpected and will be discussed in more detail in 
Chapter V. 

Figure 7 displays the comparative means with associated whisker plots 
representing the 95% confidence intervals for the treatment and control groups 
are in. 

Anticipates & Evaluates 
Ship Responsiveness 

30 

27 

24 

21 

18 


6 

3 
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Treatment Control 


Figure 7. Comparative Whisker Plot of Anticipates and Evaluates 
Ship Responsiveness Mean Scores Treatment versus 
Control with 95% Cl 
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4. Analysis of Standard Commands Scores 

The SWOS instructor assessed study participants on their ability to 
properly formulate and execute standard shiphandling commands appropriate to 
the maneuvering situation throughout their final COVE evaluation session. The 
assessment criteria and definition for proper standard commands for both the 
test and control groups is contained in Appendix H, Figure 36. Table 8 displays 
the descriptive statistics for both groups. 



Standard Command 

s 

Treatment 

Control 

n 

Mean 

Standard Deviation 

Standard Error 

Lower 95% Cl 

Upper 95% Cl 

11 

10.909 

2.023 

0.610 

9.550 

12.268 

10 

8.500 

3.370 

1.066 

7.434 

9.566 


Table 8. Treatment vs. Control Descriptive Statistics for Standard Commands 


Figure 8 shows the distribution of treatment group scores in histogram 
form. Two participants performed at the “Proficient” level, nine participants 
performed at the “Meets Standards” level. Individual participant data for the 
control group was not available due to IRB restrictions on the data. 



Figure 8. Flistogram of Treatment Standard Commands Scores 


Table 9 displays the results of a One-Tailed Z-Test and Wilcoxon Signed 
Rank Test performed on the treatment data after fitting the distribution in JMP. 

The researchers utilized control set mean and standard deviation as the 
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hypothesized mean and true standard deviation. Treatment set data displayed 
statistical significance to the 0.0089 and 0.0005 level for the One-Tailed Z-Test 
and Wilcoxon Signed Rank Test respectively, suggesting improved student 
performance in the “Standard Commands” scoring category in the final COVE 
evaluation session. 


Test Mean 


Hypothesized Value 


8.5 

Actual Estimate 


10.9091 

DF 


10 

Std Dev 


2.0226 

Sigma given 


3.37 


z Test 

Signed-Rank 

Test Statistic 

2.3709 

33.0000 

Prob > |z| 

0.0177* 

0.0010* 

Prob > z 

0.0089* 

0.0005* 

Prob < z 

0.9911 

0.9995 


Table 9. JMP Output for Standard Commands Scores One-Tailed Z-Test and 

Wilcoxon Signed Rank Test 


Figure 9 presents the comparative means with associated whisker plots 
representing the 95% confidence intervals for the treatment and control groups. 


Standard Commands 



Figure 9. Comparative Whisker Plot of Standard Commands Mean Scores 

Treatment versus Control with 95% Cl 
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5. Analysis of Aggregate Maneuver Scores 

The Aggregate Maneuver Score category consists of the previous four 
score categories standardized to a point value of 300. The aggregate score 
provides the most direct comparison method with the control data collected by 
Peters and Kirschenbaum. Table 10 displays the descriptive statistics for both 
groups. 



Aqqreqate Maneuver Score 

Treatment 

Control 

n 

Mean 

Standard Deviation 

Standard Error 

Lower 95% Cl 

Upper 95% Cl 

11 

170.909 

25.082 

7.562 

154.059 

187.759 

10 

167.000 

74.540 

23.572 

143.428 

190.572 


Table 10. Treatment vs. Control Descriptive Statistics for 

Aggregate Maneuver Score 


Figure 10 displays the distribution of treatment group scores in histogram 
form. Six participants performed at the “Meets Standards” level, five participants 
performed at the “Needs Improvement” level. Individual participant data for the 
control group was not available due to IRB restrictions on the data. 



Figure 10. Flistogram of Treatment Aggregate Maneuver Scores 


Table 11 displays the results of a One-Tailed Z-Test and Wilcoxon Signed 
Rank Test performed on the treatment data after fitting the distribution in JMP. 
The researchers utilized control set mean and standard deviation as the 
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hypothesized mean and true standard deviation. Treatment set data displayed no 
statistical significance, suggesting no discernible effect on student aggregate 
maneuver performance in COVE through exposure to the game based protocol. 


Test Mean 


Hypothesized Value 
Actual Estimate 
DF 

Std Dev 
Sigma given 


Test Statistic 
Prob > |z| 
Prob > z 
Prob < z 


167 

170.909 

10 

25.0817 

74.54 


z Test 

Signed-Rank 

0.1739 

9.0000 

0.8619 

0.4551 

0.4310 

0.2275 

0.5690 

0.7725 


Table 11. JMP Output for Aggregate Maneuver Scores One-Tailed Z-Test and 

Wilcoxon Signed Rank Test 


Figure 11 shows comparative means with associated whisker plots 
representing the 95% confidence intervals for the treatment and control groups. 
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Figure 11. Comparative Whisker Plot of Aggregate Maneuver Mean Scores 

Treatment versus Control with 95% Cl 
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c. 


EXIT SURVEY 


1. Participant Quantitative-Subjective Responses 

The researchers requested participants in the experiment to complete a 
voluntary web based survey on SurveyMonkey after completing and detaching 
from their SWOI course of instruction. Responses were on a Likert Scale with 
graduating point values from one to five, with five representing maximum subject 
agreement with the survey question. Five of eleven participants completed the 
survey. 

Figure 12 displays the participants’ responses to survey question number 
one, which sought feedback on the student’s perceived level of difficulty in with 
seeing the video output of the game based task trainer. Three participants 
responded that the tool was “easy to see.” Two participants responded that the 
tool was “somewhat easy to see.” Based on an average participant response of 
4.6, the participants experienced little difficulty seeing the game clearly. 

1 . Did you have any problems seeing the tool clearly? 
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Figure 12. Participant Exit Survey Question One Summary Responses 

Figure 13 displays the participants’ responses to survey question number 
two, which sought feedback on the student’s perceived ease of use of the 
simulation tool. Two participants responded that the tool was “easy to use.” 
Three participants responded that the tool was “somewhat easy to use.” Based 
on an average participant response of 4.4, the participants’ experienced little 
difficulty in using the game based task trainer. 
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2. How easy was the tool to understand and apply? 
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Figure 13. Participant Exit Survey Question Two Summary Responses 

Figure 14 displays the participants’ responses to survey question number 
three, which sought feedback on the perceived level of hindrance the game 
created toward accomplishing their learning objectives. All five participants 
responded that the tool was “easy to use” and had no hindrance on their learning 
or practice of learning objectives. 

3. Did the tool hinder learning or practice? 
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Figure 14. Participant Exit Survey Question Three Summary Responses 

Figure 15 displays the participants’ responses to survey question number 
three, which sought feedback on whether the students perceived that the game 
helped them to apply the training given in the SWQS shiphandling lectures. The 
student response to this question interested us greatly as it provided the litmus 
test of whether they felt there was any value in the game scenarios in applying 
the theory taught in the classroom. Two participants responded the game was 
“very much” helpful. Three participants responded that the game was “much” 
helpful. Based on an average participant response of 4.4, the participants’ found 
the game based task trainer to be helpful tool in applying classroom shiphandling 
theory. 
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4. Did the training tool help you apply training given in the SWOS shiphandling lectures? 
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Figure 15. Participant Exit Survey Question Four Summary Responses 

Figure 16 displays the participants’ responses to survey question number 
five, which sought feedback on whether the students perceived that the game 
helped them in their COVE training sessions. The student response to this 
question provided feedback on whether they felt that the semi-immersive 
environment offered in the game prepared them for COVE’s fully immersive VE. 
Two participants responded the game was “very much” helpful. Three 
participants responded that the game was “much” helpful. Based on an average 
participant response of 4.4, the participants’ found the game based task trainer to 
be helpful tool in applying classroom shiphandling theory to their instructed 
COVE sessions. Question 5 had an associated free response question. Question 
6, which we discuss later. 


5. How well did the tool help you in the SWOS Intro COVE training sessions? 
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Figure 16. Participant Exit Survey Question Five Summary Responses 

Figure 17 displays the participants’ responses to survey question number 
seven, which sought feedback on how likely the students would be to use a 
game based task trainer once in the operational fleet. Two participants 
responded that they would use such a tool “very often.” Qne student responded 
that he or she would use such a tool “often.” The remaining two respondents said 
they would use such a tool “little” or “very little.” Based on an average participant 
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response of 3.8, the participants’ would be more likely than not to continue to use 
a game based shiphandling simulation to train or practice shiphandling evolutions 
once in the fleet. 


7. If you had this tool to take with you to the fleet, how likely would it be that you would 
continue to use it to train or practice? 
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Figure 17. Participant Exit Survey Question Seven Summary Responses 


Figure 18 displays the participants’ responses to survey question number 
eight, which sought feedback on how likely the participants would be to 
recommend a game based task trainer to their peers for training and practice. 
Positive word of mouth and willingness to recommend a tool to their shipmates 
can be a powerful indicator of that tool’s perceived utility. Four participants 
responded that they would be “very likely” to recommend a tool of this type to 
their peers. One participant responded that he or she would be “likely” to 
recommend it. Based on an average participant response of 4.8, the participants’ 
would be highly likely to recommend a semi-immersive, game based task trainer 
to their friends to train and practice for shiphandling evolutions. 


8. How likely would it be that you would recommend this tool to a friend or shipmate for 
training or practice? 
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Figure 18. Participant Exit Survey Question Eight Summary Responses 


Figure 19 displays the participants’ responses to survey question number 
nine, which sought feedback on how likely the participants would be to use a 
game based task trainer to prepare for future high-level shiphandling simulator 
usage. The responses to this question provide another look into the students’ 
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perceived utility of the tool in preparing for periodic CNSF mandated simulated 
shiphandling evolutions. Though all of the participants are too junior to have 
participated in a BRM course, the research team still found value in this response 
as the participants had recently utilized the COVE, another fleet system of 
record. Two participants responded that they would be “very likely” to use a tool 
of this type to prepare for simulated shiphandling evolutions. Three participants 
responded that they would be “likely” to recommend it. Based on an average 
participant response of 4.4, the participants’ would be likely to utilize a semi- 
immersive, interactive modality, game based task trainer to prepare for simulated 
shiphandling evolutions. 


S. How likely would it be that you would use a tool of this type to prepare for simulated 

shiphandling evolutions (i.e. COVE, Full Mission Bridge)? 
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Figure 19. Participant Exit Survey Question Nine Summary Responses 

Figure 20 displays the participants’ responses to survey question number 
ten, which sought feedback on how likely the participants would be to use a 
game based simulation to prepare for live shiphandling evolutions. The research 
team felt that the tool could be expanded for use in wardrooms as a means of 
preparing for live shiphandling events. We knew the student volunteers had 
limited shipboard experience but used this question to gauge the depth of how 
they valued the simulation as a tool to train as a team. One participant responded 
that he or she would be “very likely” to use the game to prepare for live 
shiphandling evolutions. Three participants responded that use would be “likely.” 
One participant responded that he or she would be “slightly likely” to use a tool of 
this type to prepare for live shiphandling evolutions. Based on an average 
participant response of 4.0, the participants’ would be likely to utilize a semi- 
immersive, interactive modality, game based task trainer to prepare for live 
shiphandling evolutions. 
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10. How likely would it be that you would use a tool of this type to prepare for "live* 

shiphandling evolutions? 
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Figure 20. Participant Exit Survey Question Ten Summary Responses 

2. Participant Quaiitative-Subjective Responses 

The voluntary participant survey included seven free response questions. 
These questions were intended to elicit additional information from the students 
that the multiple choice Likert Scale responses were unable to encapsulate. 
Questions with less than five responses were unanswered by some respondents. 


Figure 21 displays the participants’ free responses to survey question 
number six, which sought additional feedback to survey question five. 


Q6. What specifically helped you? 

1 

It helped make you more comfortable with the commands and it also help you 
get at least a little bit of a feel on how ships handle 

2 

It helped to familiarize with the cove faster 

3 

Becoming familiar with the proper verbiage for giving commands 

4 

Just the fact that 1 had done shiphandling 3 times to my classmates' 1 made me 
far-and-away better than them, especially in the early rounds of COVE. 

5 

CONFIDENCE 

Figure 21. 

Participant Exit Survey Question Six Summary Responses 


Figure 22 displays the participants’ free responses to survey question 
number eleven, which asked the students if and why they had felt frustrated while 
using the tool to practice theoretical concepts covered in their SWQS classroom 
lectures. It should be noted that the frustration described in response 3 is with the 
current method of giving helm/engine orders on a Navy ship rather than 
frustration with a part of the game that does not exist in actual shiphandling. 
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Q11. Did you feel frustrated while using the tool? If so. please explain. 

1 I didn't not feel frustrated with the tool. 

2 no 

3 Sometimes my brain would know what to do, but it was hard to give the 

command. If I had actually been behind the wheel it would have been easier 
than taking that extra step of saying what should be done But that's just part of 
being new to this. 

4 NO 

Figure 22. Participant Exit Survey Question Eleven Summary Responses 

Figure 23 displays participants’ free responses to question number twelve, 
which sought student feedback in terms of recommendations to improve the 
game based task trainer tool or its application to training pedagogy. 

012. What recommendations would you give for improvement of the tool or its 
application to training? 

1 I would develop more ships than just the standard one so that you can practice 
different types. For example: frigates with their APUs 

2 Easy to use software for readily available practice 

3 Make the program available to everyone prior to their intro to COVE. 

4 I thought it was great. Not much I can see to improve on. 

5 NONE 

Figure 23. Participant Exit Survey Question Twelve Summary Responses 

Figure 24 displays participants’ free responses to question number 13, 
which sought the students’ opinion of the game as a training tool. 
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Q13. 

What was your opinion of the training tool you used? 

1 

1 thought it was a good tool to use, especially for people who are just starting out. 

It helped you be more confident in not only giving the commands but on what 
commands to give 

2 

It helped in practicing for the conn 

3 

Very helpful. 

4 

1 thought it was very helpful. 

5 

VERY HELPFUL AND GREAT PRACTICE 

Figure 24. 

Participant Exit Survey Question Thirteen Summary Responses 

Figure 25 displays participants’ free responses to question number 14, 

which sought student feedback on some of the things they felt the tool 

specifically lacked. The most common response was variety of ship platform 

types appropriate to current fleet models was lacking. 

014. 

What are some of the things you thought the tool lacked? 

1 

As 1 mention earlier, the only thing it realty lacked was different ships to practice 
with. 

2 

An immersion experience of being in the pilot house 

3 

Ship variety. 

4 

Well, this was the first of this type of thing that 1 ever used, and 1 have yet to con 
a ship in the fleet, so from my standpoint it didn’t lack anything 

5 

NOTHING 


Figure 25. Participant Exit Survey Question Fourteen Summary Responses 


Figure 26 displays participants’ free responses to question number 15, 
which sought student feedback on whether they had experienced any difficulties 
with information and handouts provided by the research team. The 
aforementioned items are displayed and described in Appendix A and B. While 
sharing classroom facilities with daytime SWOS courses, the researchers were 
required to leave critical course information on the dry erase boards from in 
session classes while ensuring that all information disclosed to participants was 
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displayed consistently for each treatment session. On some occasions, this 
included the information in Appendix B having to shift vertically or horizontally on 
classroom dry erase boards. All information in Appendix A and B was presented 
to all participants at all of the treatment sessions. 


015. Did you experience any problems with the supplemental information given while 
using the tool? (e.g. "cheat sheets" or worksheets) 

1 No problems 

2 No 

3 Consistency between the format of the information provided on the board 

between the first and second day. 

4 We were dealing with an overwhelming amount of new information (standard 

commands, starboard twists, etc) so to be able to pick out the proper new info 
from a whiteboard full of it was difficult. Once I learned where on the board each 
command was (engine is top right, mdder top left, etc) it became more 
manageable and helpful. 

5 NONE 


Figure 26. Participant Exit Survey Question Fifteen Summary Responses 


Figure 27 displays participants’ free responses to question number 16, 
which sought feedback on additional ideas the students had on means to train or 
practice shiphandling skills, short of actually conning a real ship. The research 
team feels that the first response holds merit in follow on research on a zero- 
fidelity shiphandling task trainer. 


016. Are there any other recommendations you can give (when not actually driving a 
ship that will help future shiphandlers train or practice shiphandling skills? 

1 I bet there's a way to practice verbalizing what one pictures in one's head, either 
by giving a multiple choice test with different wordings of a maneuver, or by 
giving scenarios and having someone answer verbally. This would be helpful to 
me. Otherwise I thought it was great, and a productive and useful study 

2 NONE 


Figure 27. Participant Exit Survey Question Sixteen Summary Responses 
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V. CONCLUSIONS 


A OVERVIEW 

The results of our data collection and analysis indicate that student 
volunteers performed at a statistically higher level in the category of “Standard 
Commands” and “Margin of Safety Maintained” than control group students did. 
These findings, specifically the standard command improvement, are corollary 
with the qualitative data we have collected from evaluation forms, surveys, and 
unsolicited instructor feedback. Standard commands improvement was directly 
observable in SWOI students. Increased comprehension and execution of 
standard command lecture content was apparent during course of the treatment. 
The SWOS instructor also observed “Seamans Eye” (comprehension and 
development of situational awareness between the ship and non-moving objects) 
increased during the course of the treatment. 

The category “Use of Rudder, Propulsion, and Tugs” score of the 
treatment group proved to be statistically indistinguishable from that of control 
group. In the case of “Use of Rudder, Propulsion, and Tugs,” the reason may lie 
in the four instructed COVE sessions. These sessions may have sufficiently 
transferred an equivalent level of knowledge to control group students and 
negated any measurable positive training effects of the treatment. Additionally, 
the instructed COVE sessions were the first opportunity for both treatment and 
control groups to exercise control of tugs. 

In the category “Anticipates and Evaluates Ship Responsiveness,” the 
treatment group performed at a significantly lower level than the control group. 
The research team thinks a possible cause is the treatment group students 
having difficulty un-learning the WHEC characteristics prior to the evaluation 
session. Additionally, the 3'"'^ person POV presented in the game based 
simulation may have induced a visual cue disparity when novice students 
entered the COVE 1®* person POV environment. The effect of viewpoint, model 
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acclimation, and individual model relearning time could account for the 
significantly lower score when compared to the control group. A solution may be 
to use models with the exact characteristics of COVE models, provide students 
with more 1®* person POV acclimation time in COVE, and implement a study with 
a game based trainer capable of robust 1 person and 3'"'^ person POV. 

The “Aggregate Maneuver” score of the treatment group was statistically 
indistinguishable from the control group and proved to be a less accurate 
measure of overall student performance than previously expected. The true data 
trends were not evident until viewed at the individual category component level. 

B. ANSWERS 

1. a. Do SWOI students who use semi-immersive, voice interactive, 
shiphandling game to practice tasks covered in classroom shiphandling theory, 
prior to using the COVE, perform at a higher level than those not currently using 
shiphandling games? 

• We believe that the results of the “Standard Commands” and 
“Margins of Safety Maintained” score categories answer this 
question. Our findings suggest that exposure to the game based 
treatments increased the score of the student volunteers when 
compared to the control group. 

b. In which assessment categories will they perform better? 

• We found that the student performed better in execution of 
“Standard Commands” and “Margins of Safety Maintained” than the 
control group. 

2. Do SWOI students who use a semi-immersive, voice interactive, 
shiphandling game to practice standard commands covered in classroom lecture, 
prior to using the COVE, perform their standard commands at a higher level than 
those not currently using shiphandling games? 

• The student volunteers exposed to game based treatments 
performed at a significantly higher proficiency level than the control 
group in this category. 

3. Participants will perform at a higher level in the “Aggregate Maneuver” 
score category. 


56 



• Performance in this category was statistically indistinguishable 
between the treatment and control group. In this study, the 
“Aggregate Maneuver” score tends to hide student performance 
trends encapsulated in the individual category components. Holding 
all other measured performance levels constant, if the same ship 
class had been available between the game based simulation and 
COVE, thereby negating the performance reduction in the 
“Anticipates and Evaluates Ship Responsiveness” score category, 
there would have been a much more significant increase in student 
performance in the “Aggregate Maneuver” score category. 

4. Participants will perform at a level consistent with the control group in 
the “Use of Rudder, Propulsion, and Tugs” subcategory. 

• Our findings suggest that student volunteers in the treatment group 
performed at a statistically indistinguishable level when compared 
to the control group. 

5. Participants will perform at a higher level in the “Margins of Safety 
Maintained” subcategory. 

• Our findings suggest that exposure to the game based treatments 
increased the score of the student volunteers when compared to 
the control group. 

6. Participants will perform at a level consistent with the control group in 
the “Anticipates & Evaluates Ship Responsiveness” subcategory. We expect the 
dissimilarity between the ship models in the game-based task trainer and the 
COVE to have a negligible effect on student performance. 

• The student volunteers performed significantly below the control 
group in this category. We thought the ship model used for the 
treatment was similar enough to a COVE DDG model that the 
difference would be minimal and easily re-learned by the student. 
This was not the case. In consultation with faculty and staff at NPS 
and a review of our findings by Dr. Susan Kirschenbaum (personal 
communication, February 15, 2012), we believe that the 
characteristics of the WHEC model, learned by the novice level 
shiphandling students during treatment protocol, may have proven 
beyond their capability to unlearn or compartmentalize prior to their 
evaluation session in COVE. Having to “unlearn” the WHEC model 
and assimilate the new COVE DDG model physical characteristics 
during the limited amount of time the students have for COVE 
sessions may have been too much of an adjustment for some 
treatment group students. For follow on work, we believe a semi- 
immersive game based simulation incorporating ship models 
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identical to those used in COVE and featuring a robust 1®* and 3'^'^ 
person POV capability could lead to a more upward trend in this 
category. 

• One possible explanation for this result is the differences in the 
ships simulated between the game and COVE. The COVE ship 
model for the evaluation scenario was a DDG with the following 
specifications: 505-foot length; 59 foot width; 31-foot draft; 8,230 
long tons displacement; 100,000 shaft horsepower (United States 
Navy, 2011). The model in Ship Simulator Extremes in a USCG 
WHEC with the following specifications: 378-foot length; 43 foot 
width; 15 foot draft; 3,300 ton displacement; 36,000 shaft 
horsepower when operating gas turbine engines (Wikipedia, 2011). 
The WHEC is a lighter, more maneuverable platform that 
responded quicker to rudder and engine orders than the DDG. This 
difference might have caused students effects to take place quicker 
after their orders. If this is the case, using a different ship class in 
the game may have resulted in negative training transfer to the 
students. 

7. Do the participants believe the game-based simulation helped prepare 
them for their use of the COVE? 

• Our feedback from the student volunteers suggests that this tool 
helped them in preparation for COVE. Instructors were impressed 
with the student level of knowledge of standard commands and the 
reduced amount of time required to establish basic proficiency. The 
students indicated that they felt more confident in executing 
standard commands and basic ship maneuvers following 
completion of the treatment protocol and carried this confidence 
into the COVE sessions. 

8. Are the participants likely to use a tool of this type in the future and/or 
recommend it to their peers? 

• Survey feedback indicated that both instructors and students were 
interested in using this tool in the future. The students, and even 
some instructors, indicated to us that they would like to buy a copy 
themselves to practice with. While Ship Simulator Extremes 
presented a ready candidate for the limited scope of our study, the 
lack of U.S. Navy specific ship models and the ability to conduct 
evolutions such as UNREP, Man Overboard, and controlling tugs 
prevents this software from filling the intermediate training level 
gap. 
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c. 


OVERALL ASSESSMENT 


The game based treatment demonstrated statistically significant effects in 
the areas of execution of standard commands and student abilities to maintain 
proper margins of safety while maneuvering. The intent of the research team was 
not to train specific evolutions or categories, but to expose students to a voice 
controlled game based shiphandling simulation and determine if the exposure led 
to increased performance in the COVE. Although the effect of the treatment on 
aggregate maneuver skill was statistically indistinguishable from the control 
group, the research demonstrated that the specific skills of “Standard 
Commands” and “Margin of Safety Maintained” increased due to the exposure to 
the game based protocol. 

D. LIMITATIONS AND LESSONS LEARNED 

This research endeavor produced many challenges along the way for the 
research team and provides a rich source of lessons learned to pass down to 
future research teams if trying to implement a study of this type. 

1. Coordination 

Foremost were communication challenges due to the long distance 
between Naval Postgraduate School and SWOS. While the staff of SWOS 
proved to be of immense help in coordinating our study, we would strongly 
recommend all who would attempt a study like this to establish contact early and 
arrange for at least one orientation visit prior to study commencement. 

2. Sample Population 

The sample size was a function of the number of OCS graduates 
commissioned by the USN as SWOs. The number of students attending SWOI 
can vary greatly from class to class, some as high as sixteen students, some as 
few as four. This is based on USN manpower needs and can prove a challenge 
to plan for. The research team recommends starting a study early enough to 
ensure sufficient class cohorts are available during the duration of your study. 
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3. 


Tasks 


The task trainer missions were extremely time intensive to build and 
implement. However, once built, the missions can be shared easily with anyone 
who owns VSTEP’s Ship Simulator Extremes software. If a future tool gaming 
package for shiphandling training is developed, the missions should have the 
ability to be shared in the same manner. 

E. RECOMMENDATIONS 

1. Utility of Game-Based Shiphandiing Tooi for Surface Warfare 
Officers 

As Surface Warfare Officers, the researchers believe that there would be 
value in an individually accessible game based simulation tool available to naval 
officers to practice common shiphandling evolutions. No COTS shiphandling 
game meets the full spectrum requirements of the professional shiphandler. We 
believe that this topic merits further study and possible funding in order to 
develop a game based simulation tool for NSST inventory. 

2. Instructor Scoring Reliability 

A single COVE instructor, fully qualified in all ship types in COVE, 
evaluated the student volunteers. This same instructor may have trained study 
participants as part of his duties training the entire SWOI class; however, the 
researchers did not inform the instructor of participant identity until as close as 
possible to the actual evaluation session in order to prevent confounds caused 
by instructor favoritism. The research team believes, if not already being used, 
SWOS could benefit from an unbiased evaluation database to compare instructor 
scores in order to drive down point variances in individual instructor scores. 
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3. 


Future Work 


a. Implement an Intelligent Tutoring System with Game- 
Based Simulation 

The students received no feedback except that given by the 
helmsman in the course of our treatments. An intermediate game based tool for 
shiphandling would benefit from having an intelligent tutoring system because the 
student would be able to receive feedback during their game sessions. The tool 
would be implemented to teach the student specific aspects of shiphandling as a 
series of lessons. The in scenario interface could be represented as a “virtual 
commanding officer” coaching the student through evolutions. The scenario 
purpose would be to teach students different aspects of shiphandling, e.g., lifting 
off the pier, evaluate, and give the student feedback in the form of a score for the 
evolution or perhaps a video replay. The lessons could be organized to best fit 
the curriculum, perhaps from easiest to hardest lessons, culminating in a final 
evaluation requiring use of all of the lessons to accomplish. 

b. Implement a True Voice Control Software Interface 

Our vision of an intermediate game based shiphandling trainer 
included voice recognition so a solitary student would be able to use it. The 
limited scope of our study precluded the implementation of software that would 
enable voice commands. Instead, we used a researcher-helmsman who acted as 
the interface between the conning officer and the software. We think voice 
control software implementation is essential for the intermediate game based 
shiphandling trainer to reach its full potential as an individual, personal, 
shiphandling tool. 


c. Development of a Zero Fidelity Standard Commands 
Trainer 

Throughout our study, the shiphandling skill significantly improved 
has been standard commands. The treatments had a statistically significant 
positive effect on the outcome of the final evaluation when compared to the 
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control group. The unsolicited feedback of instructors and the survey given to 
participants point to the positive effect practicing standard commands during the 
treatments, prior to the higher level simulation. We think a zero fidelity standard 
commands trainer utilizing basic ship models and visual representation of effects 
of forces on the ship could aid new officers in learning and practicing standard 
commands prior to high level simulation. 
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APPENDIX A. PRE-EXPERIMENT INSTRUCTIONS AND 

MATERIALS 


CHARTS 



Figure 28. Mission One Participant Harbor Chart 



Figure 29. Mission Two Participant Harbor Chart 

63 













Figure 30. Mission Three Participant Harbor Chart 



Figure 31. Mission Four Participant Harbor Chart 
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SWOS STUDENT LECTURE REFERENCE MATERIALS 



Shiphandling 
^ Fundamentals 



REFERENCES 


I NAVAL 

iplLiitdltr's ^SHIPHANDLINC 

CjLlLllf 


( 

if_ 
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SHIPHANDLING 

SHIPHANDLING ISA 
COMBINATION OF ART AND 
SCIENCE 


TEIE ART SKILLS ARE DERIV ED 
FROM EXPERIENCE AND NATURAL 
ABILIT\^ 

THE "SCIENCE* SKILLS ARE DERIVED 
FROM KNOWLEDGE AND TRAINING 
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SQUAT 



The hull of a shi[i sinks 
as Lho ship increases 
speed. The iww v^ill 
begin to rise and the 
stern will! begin to sink. 

It is amplifie'd by shallow 
water and results in 
large wakes. Harbor 
speed limits are 
designed to prevent 
ships from squatting and 
generating destructive 
wakes. 


PIVOT POINT 


♦ The point about which a ship rotates is 
called the pivot point. The position of 
the pivot point moves forward with 
headway, and aft with sternway. 
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PIVOT POINT 


Ship at rest. 


• At sea with ahead bell. 


Fftffu bif/c 



< All stop to ahead. 


Mach furthnr ftnnvan? - ^arpn- hvttf cn rlBr^ movwmirTr. 


► * Astern bell. 


fmdM Jifgi) H>n (fafff, APU'f-J- EITtfbf 
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TWIST 


+ A spiral curve or turn resulting from 


side force and torque, usually brought 


about by ordering one engine ahead 

RL J 

and the other engine back, with rudder 
placed in the direction of the twist 



- StariiCJard comm anti used Co place a 


clockwise (starboard) twist 

^^HHnKvjpni^ 

• Flight full rudder 

• Port engine ahead 1/3 

• Starboard engine back 1/3 



SHIPHANDLING 

CHARACTERISTICS 


* Several characteristics must be 


understood to become a 


competent shiphandler: 


-Advance 


-Transfer 


-Tactical diameter 


-Turning circle 
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ADVANCE AND TRANSFER 


* Ad’f'Eiice- 

- DisUuici: gaino] 
eHl diruclian. af Itrc 
[original caiirsc aflLT 
thL mjdJcr is pjLavur. 

* Transfer 

— Disljuicu gadneJ 
pcipcniidLU jij Id Ifu: 
original caiinK' ailin' 
thL nidJur is fratavur. 


TACTICAL DIAMETER 

♦ The distance traveled perpendicular to 
the original course when a ship is 
turned to a reciprocal course. The 
tactical diameter distance is measured 
from the time the rudder is put over. 

- Tactical diameter is a function of ship's 
speed and applied rudder angle. The two 
types of Tactical Diameter include: 

* Standaird Tactical Diannetcr (Standard Rudder) 

* Reduced Tactical Diameter {Full Rudder) 
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TURNING CIRCLE 



A ship's turning circle is 
the path follewcd by the 
ship's pivot point when 
making a 360'' turn. Its 
■diameter varies with 
ruiJiJer angle and speed. 
With constant rudder 
angldj an increase in 
speed results in an 
increased turning circle. 
Very low speeds {those 
approaching bare 
steerageway} also 
increase the turning circle 
because of reduced 
rudder effect. 


TACTICAL 

CHARACTERISTICS FOLDER 

+ The ship’s Taccicat Characteristics folder is a 
document^ usually an appendix to the 
Standing Orders, that lists the ship's design 
and handling characteristics. The information 
contained in this folder is invaluable to a new 
Conning Officer. Some of the design and 
handling information found in this folder 
includes; 

- Location and number of screws/rudders 

- Length, beam, height of the ship 

- Location of pivot point 

- Acceleration and dcccleraticm Lahles 

- Advance and transfer tables 

- Ship's navigational draft 

- Turn diagrams for various speeds an^d rudder angles 
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TWIST 

+ A Spiral curve or turn resulting from 
side force and torque, usually brought 
about by ordering one engine ahead 
and the other engine back, with rudder 
placed in the direction of the twist 

- Stanidard commarnS used to place a 
clockwise (starboard] twist 
» Right full rudder 

* Port engine ahead 1/3 

* Starboard engine back 1/3 
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INERTIA AND MOMENTUM 


+ INERTIA '. Inertia is (lie quality of iHiMion, tlmt causes a 
sliip to resist a change in motion. “A foree ejterted on a 
ship will result in motion after inertia has been 
overcome. “ 

+ MOMENTUM '. "'Generally, we consider momentum as 
the motion of a sliip at the time we no longer want it, 
especially when we have taken action to obtain the 
opposite efTect. . . . Monientuna is the quality of motion 
measured by the product of mass & velocity."' 


Ilooyer - Behavior and Handling of Ships 


INERTIA AND MOMENTUM 


♦ INERTIA '. "The rnotioii that doesii't happen 
when we put the bell on! ” 

♦ MOMENTUM '. "'The motion that' a still there 
afler we look (he bell off!” 













SHIPHANDLING FORCES 


CONTROLLABLE: 


■ PRC3PELLKR 

■ RL'DDER 

■ BC}W.■?iTER^ TIERESTEKJi 

■ ANCHORS 

■ TL<;s 

■ LI\ES 


SEMI-CONTROLLAELE: 


■ SlIA [.LOW MATER EFFECTS 

■ BAVK CUSIIMJ-N.'ILLTEOV 


■ PASSING SI][rEI'FEtTS 


UNCONTROLLABLE; 


■ WIND 

■ CLKREST 


PROPELLERS 


+ Propellers or screws consist of multiple 
blades that are rotated by the main 
engine shafting. Propellers move ships 
through the water a certain distance 
with each rotation. This distance is a 
function of the pitch and/or rotation 
rate (rpm) of the blades. Types of 
propellers include Fixed Blade and 
Controllable Reversible Pitch (CRP). 
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FIXED BLADE PROPELLER 



A ship's speed throwgfi 
the water is a function 
of the fixed blade 
pitch and the shaft 
rotation rate. 

When 5 fixed blade 
screw is rotated in one 
direction the ship will 
move forward, when 
reversed, the ship will 
move backward. 




SINGLE PROPELLER 

Fixed Pitch 


TURNS 

cw 

AHEAD 





TURNS 

ccw 

ASTERN 
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TWIN/QUAD 
Fixed Pitch 


ASTERN 


COLPLLSIDE 
FORCES 
\ CAN'CEL 


THRUST 
FORCES 
COMPLEMENT 



ENGINES OPPOSED 
ALL FORCES 
OMPLEMETCT TO 
TWIST SHIP 


I.IIA-I.IIU 

TIRN 

IVFtaARD 



CONTROLLABLE 
REVERSIBLE PITCH 



Propellers on which the 
blade pitch (angle of 
blade) can be changed 
arc called Controllable 
Reversible Pitch (CRP) 
Ship's speed and 
direction through the 
water a re a function of 
both shaft rotation rate 
and ordered screw pitch. 
The direction of shaft 
rotation is always the 
same, even when 
backing. 
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CONTROLLABLE PITCH 
PROPELLERS 
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SIDE FORCE 


When d screw roLates^ a side foree is produced which 
will cause the ship's stern to meve either to starboard 
or to pert. If a ship is slowly moving astern, 
movement is best eontrolled by the side forces 
produced by the propeller. 

Clockwise rotation of the screw produces a side force 
which moves the stern to starboard. 

Counterclockwise rotation of the screw produces a 
side force which moves the stern to port. 



i'l'ngfc fCJT-w ftt/pf wtU cjqocncrsrc- j /{jjtc wh/ett m^y Jjavc- 

ifti fioiSfMiiit 10 limit (fie .■na'TSuv-sr/n^ ojnnliiltiioi. 



TWIN SCREW 


Twim screw ships are 
designed so that the 
shafts and screws 
rotate in opposite 
directions so that 
side forces are 
camcelied out, 

On fixed-pitch ships^ 
if the engines are 
opposed, then side 
forces wili 
compiement each 
other and the ship 
wiil twist. 
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MCK)RING LINES 


FWD or AFTE R = dijicML-oai 

in which. I inc leads froum ship BOW or QTR = point of 

vcisd frornwhich Line Kiids 


+ Lilies :ai:« used next co a pier (o coiicrol/assLsl sliip 
positioning 

+ Each line has a specitle name, indicating location, 
direction, and purpoie 


BREAST or SPRING = 
dcjiciHling on me of line 


MOORING LINES 


1 - Bow Ime 

2 - After bow spring line 

5 - Forward bow spriitg Kne 
(No number) - Breast lioe 

4 - After quarter spring line 

5 - Forward quarter spring line 

6 - Stem line 
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LINE COMMANDS 


Cotiunajid 


haa ucr |'ik aui^cr 

End lirE nuc:bc ucr Her UY-zi b 4ie pici. PI^ljc L}ic cyc 
onn buUAnJ ur eI-ciI bcl-iu no! Llee j aLnJn 

SlaiJc r,aiu4 ulT^i Lie bjv krv: 

hr]- •siJC Ikv kne, cJItrAinx^ Id runr. in eu^ kip^L 

IVic 1 mu HI ?K iH'niirtKr hmI 

Fu' ninftir hk Int urtfrwiifwj. 

Tik: in Lhc alicL un 4 uee{ie auii^-ci 
Arrrji 

hicasT- i&on reji^ki ikm lire, kiit Je atii Like i alnri. 

Hue llrce 

Pa> oi/ iFjrrlic 4ucr Ide cufji^ Lu rccxn-c inoil uf ikr 
Vision. 

heiVTI 

%i|> k<¥'tiG i.'^nE in] 

(.'ttKJi iJlIM 

I4c4d mrrdfTdirK Ine. ini m lo ilw iTHkinj iwin. lei 4 k 

iaE u acEctTMiY 

HuU. Iho 

i^E ntnj^ liEm au Linl :rjrri>ci hvu Irvc will uJC al^. 

rkiiiilc up EuJ aesm 

Rue. jaiiifeuccJ Inn, lt b^l-ia uflicn, u aEci^l, Lu :ruEE 

nocinnswre. 

^njiEup 

T.^c n 4TI linn rEECTiE t nnilE vinAnt pin w «Kt seven. 
pr:?Mriicri"B pinns UHfcmii' 

Suiri bv' iwrliDM 

Mit itE liK9. mdy in Ein nil orin«)r 

Tck: in ucr fir auf^ci ur:-:|i 

RcL~n'>c kn: Rcin^-ci urc kTIb iL Iw kem uni ufE 

Vp ^lv>i 

CmE kiujknjton Lhc line l'iJ ilmii il ifukuily. 


SCREW CURRENT 


1 




Consist& of two parts 

- Suction Currant - going into the propeller 

- Discharge Current (Prop Wash)- comes out of 
(he propeller 


Suction Current- 


■+ Discharge Current 
Acts on Rudder 


Propeller 


81 


































PROPELLERS AND 
RUDDERS 


m 


Primary means for controllirig the stem 


Thrust 



LT 


Side Force 


^Rudder Force 


RUDDERS 

* EfTecliveness based on speed vs rudder angle 

- Ship’s turning rate propoitional to rudder 
an^e magnitude and ship’s spee'd 

- "bare sieerageway” - minimum speed at 
which rudder is slill effective (2-3 kls) 

Large rudder angle = low speed 
Small rudder angle - fast speed 
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BOW THRUSTER / APU 


BOW TEIRLSTER 


APU 


TWO LMT!i 
^.^CEI .^0 DIXf 
IVDEPENDAM 
□% -OFE'' (JXLV 


LHAyARS/MCM 


FFG 
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NARROW CHANNELS 



* Proceed at slow speed keeping near middle 

of channel to avoid the following: 

- Bank cushion - wedge of water between ship 
and bank builds up forcing bow out sharply 

- Bank suction - decrease of water level near 
quarter due to suction of screw to bank = 
draws stem closer 

- Act together to cause sheer twds opposite bank 

* Avoid overtaking/passing in this situation 



BANK CUSHION / SUCTION 


BANK 



Biink Cu&Nion 
Bow Ropollod 


T“' 

Bank Suction 
Hull Dirawn In 


Ship holds 
headiniG wUh 
rigHt iniddai' 


84 
















SHALLOW WATER EFFECTS 


Ship incrti^ses speed, it starts to sink lower 
in the water 

- Distinct bow and stem waves arc formed 

- Water level amidships becomes lower that the 
surrounding water 

- Bow starts to rise and stem sinks = Squatting 

- W^ake can cause damage to shore structures, 
anchored boats, moored boats 



SHALLOW WATER EFFECTS 
ON SHIP MANEUVERING 


HEEr SHALLOW 
WAFER WATER 


Tl C. IJiCLfc 

umiKL’rn 

ABOIT JK iHIPi 
ursicm 

AAA PLIUM.K 

R.\Tb; 0¥ TLH..V 



si'rru [.{jss lv 

tuh-vs 




(;Ft>:Ar>:K 

i.Esa 

to.vsiiM; 

U[S■|■A^t■E 

LtAS 

A-IKKAI KK 

U[Ki;fl'IO>AL 

STAai[.rrv 

I.E.S!; 

CRKArEH 


KHAi.uow w\ii:hai.ku Ll^u^:K ki:kl 

BT i>: 

ikhat-t mi ip' 4 ; sniKii 

iyCJlEA^EfijA.\fiS0ll*Ti:l\CliIJt5E l?i DFUKT 84 

mjw C.1H n-:R'ii AS siiij^ s srKKn i m.uka;s>:s 
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WIND 



* FraeboahdMhe vertical 
distance fronn the 
waterline te the 
weatherdeck. 

* Sail area; the entire 
surface area of a ship 
above the waterline that 
wind acts upon. 

* Wind will have a greater 
affect a ship with a high 
freeboard 



GENERAL RULES 
CONCERNING WINDS 

'^1 * A sliip's bow will seeL [he wind under headway 

* A ship will broadside to the wind if it is not making way 

* A single screw ship will normally back into the wind 

* Wind usually has more effect on a li^t ship than a 
loaded one 

* Tlie elfects of one knot of current will roughly equal 30 
knots of wind, but this will vary with ship's draft and sail 
area 

* As wind speed increases the force increases 
ejcponentially 
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CURRENT 



* Affecl ihe movement of the underwater portion 
of the hull 

- Ocean currents can go undetected 

- Set vs. drift 

- lidal currents easier la visualize 

+ Ships that are heavy with low freeboard = 
afTecled 

♦ Must compensate for current or nm risk of ship 
being set off track, running aground^ etc... 
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TUGS 



♦ Voith - Schneider. 

- Cycloidal Propeller 
(MU C class). 

- ^’Eggbea(er‘" Design. 

- Qiiick Response. 

- Handle liigjier 
Speeds. 


TUG POWER 


♦ USN measures tug power in Horsepower. 

♦ Civilians measure power in Tons, of Bollard 
Pull (BP). 

- 100 Horsepower" 1 Ton Bollard Poll (2500 IIP ® 
25 Tons BP>. 

♦ Review LOCRHQ response for tug power (20 
TonsBP; 30 ToiisBP+). 

*■ Visually confirm type. 
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TUGS 

Conunainds 



* Tractor Tugs 

■ Pin to the Pier (3%) 

- Dead Slow (10%J 

- Easy (15%) 

- Half(60%J 

- Full (100%) 

■ DirectiotL 

■ Toward 

■ Away 

• Outside of homeport-discuss with pilot. 


TUG MAKE-UPS 


1 > 


Sin^ie Headiine 

* Simplest Tie-up. 

* Best to allow tug to push or 
pull only. 

* Not good if complex lug 
maneuvers required. 



/ 
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TUG MAKE-UPS 




TUG MAKE-UPS 



92 






















PILOTAGE 



* Pilot' !i presence onboard does not telieve 
the CO from responsibility for navigation 
or ship fondling, except for. ■. 

- Panama canal 

- Dead stick move by order of Base 
Commander 

- Dry dock (sill) 
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3. 


SWOS STANDARD COMMANDS LECTURE 



Standard Commands 


1 


NS-2 




Terminal Objective: 

• Understand the importance and proper use of 
standard commands to Conn the ship. 

Enabling Objectives: 

• State the meaning of standard commands to the 
Helm and Lee Helm. 

• State the purpose of issuing formatted standard 
commands and explain the necessity for utilizing 
exact phraseology for standard commands. 

• State the sequence of a helm order. 
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standard Commands 


In general, standard commands must be loud and 
clear so that various watch standers may respond 
appropriately 

Standard commands follow a basic format which 
helps to avoid confusion and ambiguity 

There are four parts to a standard command 


- Command : “Right standard rudder, steady course 000." 

- Reply; "Right standard rudder, steady course 000, aye sir." 

- Report: "My rudder is right standard, coming to course 000 sir.” 

- Acknowledge: "Very well.” 


3 


- Report: "Steady course 000, checking course 002, sir." 

- Acknowledge: “Very well.” 




Commands to the Helm 


Basic format for a 
helm order has 
three parts 

- Direction of Rudder 

• Right or left 

-Amount of Rudder 

• Number of degrees 

- Course to Steer 

• Given in degrees 
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Special Steering Commands 


Course change is 10 degrees or less 

- "Come left/right, steer course .. 

Course change is greater than 10 
degrees 

- "Right standard rudder, steady on 
course.. 

• Increase or decrease the amount of 
rudder 

- "Increase/ease your rudder to .. 

• Steady as she goes 

- Helmsman will steady on the course in 
which the ship’s head was pointing at 
the time the order was given 

• Meet her 

- Helmsman will put on opposite rudder to 
check but not stop the swing of the ship; 
followed by a course. 




Special Steering Commands 


Shift your rudder 

- Equal and opposite of ordered rudder 

Rudder amidships 

- Reduces rudder angle to zero 

How's your rudder 

- Exact angle of the rudder at that moment 

Mark your head 

- Exact heading of the ship at that moment 


6 
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Special Steering Commands 


Mind your helm 

- Warning to the helmsman to steer more exactly 

Steer nothing to the left or right of_ 

- Used for close maneuvering situations 

Steady as you go 

- Command to the helmsman when it is desired to 
steady the ship on the exact heading when the 
order is given 



I 


Conning Officer Tips for Standard 
Commands 


I • In general, the amount of rudder given for a 
I course change should not exceed the 
I number of degrees in the course change 

■ • Conning Officer must oversee the helmsman 
" through the entire turn 

• Avoid giving too many commands or giving 
too few commands 

• Always look in the direction that you are 
turning before you give the command to turn 

- ^ 
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Commands to the Lee Helm 
(Fixed-Pitch Propeller) 


( • Basic format for a lee helm order has 
four parts 

- Engine desired 
• Port, starboard, all 
- Direction desired 
• Ahead or back 
-Amount Bell/Speed 
• 1/3, 2/3, etc, 

- Revolutions desired 

• “Indicate” and the three digit RPM desired 





Commands to the Lee Helm 
A^JControllable-Pitch Propeller) 

Basic format for a lee helm order has 
four parts 

- Engine desired 

• Port, starboard, all 

- Direction desired 

• Ahead or back 
-Amount Bell/Speed 

• 1/3, 2/3, etc. 


10 


- Speed desired 

• Say speed as a number "fifteen knots” 
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ecial Commands and Reports 


Backing Bells 
Using revolutions 

- Station keeping 

- Handling Alongside 

- Restricted maneuvering 

- “Indicate_% Pitch Port/STBD 

shaft’ 

• Used on Diesel or GT ships 

- “Indicate 999 revolutions for 
Maneuvering Combos’ 

• Used only on Steam ships 
Emergency 

- Helmsman will indicate three 
times in rapid succession 

How are my engines 
Bow Thrusters 

- Right or left, 1*10 
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Summary 



STATE the meaning of standard commands 
to the Helm and Lee Helm 

STATE the purpose of issuing formatted 
standard commands and explain the 
necessity for utilizing exact phraseology for 
standard commands 


• STATE the sequence of a helm order 


12 
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Review 


• What is the purpose for using a Standard 
Command? 

• What are four parts of a Standard Command? 

• If a course change is less than 10 degrees, what 
order is given? 

• What will the helmsman do when the order “Meet 
her” is given? 

• Name two tips that the conning officer should follow 
when giving a standard command. 

• What is the purpose of using “Indicate 999 
revolutions for maneuvering combinations”? 
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Standard Commands 
Handout Exercise 


14 
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Questions? 


15 
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4. 


PARTICIPANT IN-BRIEF 


The participant in brief was conducted using a checklist in order to 
standardize the process for all involved. This insured that from the moment of 
entry into the classroom by the participant until the start of the scenario, no 
participant was provided any additional guidance or information that had not 
been available to others. 

Participant In-brief 

1) Complete Informed Consent form 

2) Complete demographic survey 

3) ShipSim Extremes Coast Guard Cutter characteristics 

4) Discuss material on dry erase board [ Available in class presentations] 

- Proper order of conning commands 

- Helm Orders and corresponding Rudder Positions 

- Engine Orders and corresponding Bells 

- Propeller Walk effect 

- Twisting the ship 

- Harbor speed restrictions (scenario 2 & 4 = 10 knots) 

5) Show available printouts and reference materials 

- SWOS Standard Commands lecture (NS-2) 

- SWOS Shiphandling Fundamentals lecture 

- Barber’s Naval Shiphandler’s Guide 

- SWOS COVE Standard Commands reference sheet from binder 

6) Discuss mouse operation with student 

- Zoom (In / Out) 

- Pan (Left / Right / Up / Down) 
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7) Ask student if they have any questions about material covered (steps 3 
through 6) 

8) Start scenarios 
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APPENDIX B. CLASSROOM FACILITY SETUP 


WHITE BOARD: 

Engines (Ahead) 

1/3- approximately 5 knots 

2/3- approximately 10 knots 

Standard- approximately 15 knots 

Full- approximately 20 knots 

Flank- approximately 30 knots 

(Back) 1/3, 2/3, standard, full, emergency 

The students were reminded that the backing bells were not for a specific 
speed, and could not be ordered as an Ahead bell. An example from the SWOS 
lecture was provided for the students- “All Engines Ahead 2/3 for 8 knots.” 
Rudder orders were then covered: 

Rudder Amidships (0 degrees) 

(Left/ Right) 

Order rudder by degrees 1 - 30 
Standard (15 degrees) 

Full (30 degrees) 

Flard (35 degrees) 

Below the breakdown an example was given that was also in the SWOS 
lecture. “Right Standard Rudder, steady on course 000” 
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APPENDIX C. RECRUITING TOOLS AND DOCUMENTS 



The Sea of Simulation 

An Analyisis of Game Based Shiphandling Software in Support 
of the Surface Warfare Officer Training Continuum. 


• M lit 
Aipfitni 


[ENTER DATE OF RECRUITMENT HERE] 
Participation is voluntary. Your participation will support 
Naval Postgraduate School thesis research. 


Researchers: LT Ben Bernard and LT Ethan Reber 


ronfnrt if ytm wart trt vnlmitfwr* 


107 








Naval Postgraduate School 
Consent to Participate in Research 

Inlmduction. You arc invited to participate in a rcsearch study untitled: 

“The Sea (^'Simulalion: .4n Analysis of Game Based ShiplMiulling Simulation Software in Support 
of the Surface Warfare Officer Training Continuum" 

Purpose. Thu purpose of this study is to discover the ellcet on student COVE pcrrunnancc when exposed 
to game (vised simulation prior to OCS SWO Intro COVE naining. The study will statistically determine 
whether game based simulation has any effeet on overall COVE training ctTcctivcness. 

Procedures. This study will require up to 24 volunteers. Each volunteer will be asked to fill out a 
demographic questionnaire. The researchers will provide participants with game based shipliandling 
simulation scenarios after students receive the SWO Intro Shiphandling lecture and before they luive been 
given COVE training. The participant will perform Cunning Officer standard verbal commands and the 
researcher will act as the console operator/ helmsman. The treatment will occur over a period of two days. 
On each day, patticipants will be given a practice simulation scenario of 10 minutes as a warm up to their 
respective task scenario. In the subsequent task scenario, the participant will consecutively get underway 
from, and moor Ihe ship to a pier. Each scenario will have measures to increase difficulty that will be (lie 
same for each participant. The rcseardiers will nut offer training to the group. Participants will be provided 
w ith Conning OtTicer standard commands as given in the SW'OS COVE instructor handbook and can have 
their notes as reference material. The simulation treatment scenario is designed to last a total of one hour 
and 30 minutes over two days, the COVE evaluation will last one hour, flic treutnient givai to participants 
will not interfere with the (X'S SW'O Intro course of instruction. Upon completion of SWO Intro COVE 
training, a qualified COVE instructor will evaluate the participants individually after working hours 
utilizing a modified CRESST Conning Officer Shiphandling Assessment form. The COVE evaluation 
scenario will be getting underway from, and mooring to. a pier. Upon completion of the COVE evaluation 
the participants will be asked to complete a post-study demographic survey using Survey Monkey. I here is 
no cost to poiticipalc in this research study. 

Voluntary Nature of the Study Your participation in this study is strictly voluntary. Participants must 
have vision correctable to 20/20 and must not be colorblind. There is no cost to participate. If you choose to 
participate you can change your mind at any time and withdraw from the study. You will not penalized 
in any way or lose any benefits to which yon would otherwise be entitled if you choose not to participate in 
this study or to withdraw. The alternative to participating in this research is not to participate in this 
research. Participation or non-participation in this research study will have no etfect on academic standing. 

Potential Risks and Dbtcomforls. Tlie potential risks of participating in this study arc: 

Data mismanagement: personal demographics w ill be collected and there is minimal risk data could he 
lost. 

There is minimal risk that a participant wlio unsuccessfully ciunplctes tlic game based tasking may have 
feelings of inadequacy or lower conlidcnee. 

The student may experience some simulator motion sickness. Participants will he immediately removed 
from the study ifhe or she has signs of motion sickness. 

Anticipated Benefits. 


108 


I'hcrc ii no direct benefit to the participants. 

Pisstihlr Kle*rl Tiainit^ Iwoofilf 

Using a game based sliiphindling smulaiion sonwarc package nay make training m the Conning Oflicer 
Virtual liiis ironncnl (COVE) niurccrTcctisc Tile game boied snnulalKHicuulJ |Meiiliilly tv used Heel* 
wide in prepraton fer available siinulaior line. The wl'tware could also provide a way to remain eiirent 
foi those shiphonllcrs that have not been able to practiev an evolution for an cvluiided period of time. 
I.astly. the simiililinncould poivide a wirdmun with i proven visual tool that can he tried to walk ihnuiyh 
evolutions with ship drivcfs and bridge teams. 

CompcnsalMin for Participalion. 

No tangible compensstion will be given. 

Conddrnlialily & Privacy Act. Any infonration that is obtained during this study vvil be kept 
voondoilial to iIk full c.Mciit pcrmiiicd by law. All ctTviu, wiilim icasoii, will Ih; made to keep your 
personal intbrmacion in your researth record confidential but total confidcniialiiy cannot be guaranteed. 
Panicipant intbmalion will be scanned to PDF and stored cn the secure Naval Postgraduate School 
server Hardcopy's will br destroyed after scanning to PDF (Thr Ui\l fiiiw-nfaparth-ifutni'f 
leltphine mirtbcr wr/i he teconkd as tm idenlificatinn number ID tmmbtrs wi// hr useJ to keep irtKk of 
3t»Aicnl >s(/rra •«»/ wii/ be u3eJ la p^ir the reju/i3. u/n/ vrurs of xrvUe » l!/ atyu he recori/cUhut ell/ 

only beatsoeiiiled wiili IJeiiiifKalivn nutiher. ) 


Points af Canlnrl Ifyou h.avc any tpicsliom nr commcnls about the resenreh. or sou o\p«rwnc« an iijury 

or bavequcstioni about any discomforts that you exocneno^hd^akin^ra^iyfo^ndy please contact 
Uic liivcsiigakir, CT)K duc-Mulllvaii, absul 

voar rifdits as a research subject or any «vlict .oiisem^M^^^u'oioNct^^l i^NjT^^tgfiiduaie 5ickiol 
IRB Chiir. CAPT Join Schmidt. USN. 


Stulemrni of Cooscnt. I have read the iaformation provided above. I have been given the opps'rtunily to 
ask quevikHb and all Sie qacslkms have been answered to my saii.sfaciion I have been provided acopy or 
this form for my records and I agree to ptrticipale in this stixJy. I understand that by agreeing to 
paiticipite in this rcseiioh and signing this form. I do not waive any of my legal ri^ts. 


Parlicipini's Signature 


Dale 


Rocaichci's Signature 


Dole 


KPS U 1 

APPPOVID 
or’ 0 7 ’flu 
txfl»ts 
MAR 3 0 2012 
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Demographic survey 


ID# (last four digits of your telephone #): 


1. Do you play video games on computers (e.g., PC/MAC]? 


2. Have you ever played simulation video games on your computer? 


3. If the answer to previous question is “Yes”, have any of the computer 
simulations been related to naval or commercial shiphandling? 


4. Ifyou have played video games on your computer as described in question 3, 
what amount of time would you say you have contributed to the game in the 
last 6 months?(e.g., hours, days, weeks, months, etc.) 


5. What amount of time have you spent playing simulations other than those 
related to question 3? (e.g., hours, days, weeks, months, etc.) 


6. What amount of time have you spent playing any video game on a computer 
in the last 6 months (non-console, Xbox, PS3)? (e.g., hours, days, weeks, 
months, etc.) 


7. What level of shiphandling experience do you have? E.g. recreational, 
military, commercial (Please include shipboard qualifications or any 
commercial simulation time like COVE or Full Mission Bridge) 


8. Do you ha ve sail I ng experience? 


»fS 1(8 


*PP«8(E0 

OCT 0 7 2011 

[XPl((S 
MAR 3 0 2012 
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STANDARD COMMANDS 


* u^Tco Mg coA r>< coMr« «*oc< AicooMrno* 


DrjraM 4N0 Am- no* H%r^o to ar * T,i»m<ie con tk nxrr 




*v" «we« tOifcowMA 


^’t* f*otm mu/ 


iMccAMorcAonof nyirroMM 


•t >«rt WMU'M' 


secoiMJMW, T>«ecafFuTtM •NOauMMMraMcxiMopt. 


At^KHomxooM «MtM ■>■»? mmu 


UPS lie 

APPIOIED 

OCT 0 7 2011 
EXPIIES 
UAR30 2W2 
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UCKMUmUEUD 


To^aoowTMiogT—ti4»^titwDtwo<MMxv iaei#TT>«tfFo»>.<tM 


’Ai OTiMM •••■« KU 
WJtmXlQt 0 >i*>i n i 
W nu ^ 


n«E«l»«IIAN| 

KKKtv 


■ MMadxlQC 


M«M^w«wS 7 Ma 

^MXfc» 


A* X—* W 

Mr m «• ay*. 99 lm- 0 f 


Iv AM ib ■!« SkAtram 


Nr 

mcm 

Nrlicir««i«a»CaiAkMk*faaiai.«»MlaOT*r trifi1>f-r|fr 
aai>iiainrr«-«f> ar •kMtf ^ 

WC«I worn rNNMTM COMMaMO* 

l»>»in»>«aaw *|9»*wap 


«« •aarwa v* aiMa MX 
MrXMxK 

« «■• M IkMAi M •T«e XHIAA t. PQMT tACX I 
*a mm rnittm* nN MMtVan 

VvuMi • PW 2S 



nNMMBMMir 


vtnvnpAfVftap* 


*9afl PM M STVO MVW*, 

NMtwk 

»OMT ar4 SfW AMA 


farXCfVrW *M» Af«tattol«a* 


PaiffMirwifanar 

•PCWT •*« »t«0 MV «tiQppa^ 
arV SM a^ M 1V 

TM STIP aw tm ilf f 

M •nyPiM »* ataM X U 



POK otapittc* fo wont PONT *a« irpMONO fOO€nmmi 

i«MMa an** **»<*»*’ UM aai a»a» w »Bpat»» 

ATK,S«*OMa 


aa^irprw M«a««*n a 


N«atMi 

IMP NOV TtMMCTOI CCMMAMM: ( 9 M « SC n «* *M 




mr* SrMftx 


a« XK kia AfXL SMMrap) 


PP^MMarwM M 


VMraia »»K **a»aapi*«< 
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<PPR0ir[D 
OCT 0 7 2011 
CXFIRES 
MAP ? n 9 nn 


112 









C^VE t\jal 


Appendix A. CRESST Svsiu^tio/i Sh^t 


Sf AWOARO »Mn*ACC fORCI SN PMANDl IHG ASSi&SMtUr SHEJ T ,»** « Wai 10>1| 


•4f<A y 


/ RQ« ita# ■!•»>» ■- 

tmh 4 b» kh«f dwr«Mg • IIQA1 4 «| 

«MiMrv, •» l.lil 

- *--T fi M« .iJT ■** ■*1^* **"***^*"^ "**" «wtoa«l I94U.A *T» 

O *^^*^***"*^*** IIM «Kb.,^r iMfllMt 


r,»»^ a Cl tWT.* 

f*bl* i Iw Tatli o«tcvi|tnMi| 


»t T«(ka. fcaadMAi, r<»««tano 


tilMt MM 

W_ i*i 


AITUATIOMAL AWARLMesS (IS^l 

• »ft*nr»nMul r>w»n 

• i*»» ( F1«oi 


MOXtON MAKIMG (|$H1 

• l*>wvWtM ^liArt 

MANfeWCR 

• RUMMlItvIlMi 

• «mJ Tun 

• .VMmiiuim • !*«»■«(» 

• UjMi«nl '^iTafuwiv 


Q) 


6rL,Jh>^ 


COMAttlNId TION f I OAk) 


ma 

hA 


VPS IK 


APPtOVEO 

OCT 0 7 20tl 


EXPIRES 

MAR 3 0 2012 
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Panto. Rtkki (CIV| 


From: 


R«til>r En«n<LT) 

Wednesday. Saptemtiet 14 2011 2.14 PM 


Sent: 

To: 

Cc: 


Pan* RMii (C<V) 


Bernard Beniamin (LT> 

Revoed IRB & Ejdt Survey bliab 
Bernard _Reber_iRB-Apptcalion pdf 


SubiKi 

Anachment*' 


Rikki. 


Ptoaoc xe attached our IRB application waih the leconvnended ctiangey Ip ekXJi 23. 
PlCMe tee befow for ent survey e-mall Murh: 


Deer Study RarWopawl . 

We weiAd toe to take this opportunity to thank you for your Miihngrtess to support our Naval Fosigtadueie School thesis 
research end your rakuoblr contrtMdons to our etfoitsl 

4s dKcussed during the inaiil rwTutoncrt phase and again on the Informed Consent form, y»e are now requetii^ your 
voAiritary complition of an online eat survey. 

The survey Is avwMto through the following URL: IHSBUT SUHVgYIIOItorif UWL HgM 

To compMs the survey you w« need the 4 digit identification number selecced by you on your first day of study 
paitKipaaon and atxxx IS mnutes of your Utne. This nwrber Is most toely the lad four di^ of a tel«f>horw nunfom you 
are famaar nfm. Cut V you no longer have access to rtw menber, please contact LT Ben Bemafo at 
tabemanftnp&edu and we wM niabksh a temporary KtenttflcaCion number for you to access the onDne control. 

The Survey ndi attempt to gather yxr oplidom on the shiphandling tool you were Ciiposed to Its perocired ubkty to 
you and the foevy. Compfobori of thk survey is vchjmary and, m the event you feel the guestlonft) to be nsroive or of a 
personal nature, need not be completed In Its entirety. 

Once again, nu rroukt like to thank you and wdfi you the best of luck m the Heel' 

Respectfuty, 

LT Ben Bernard, USN 
LT Elhan Reber, USN 


VJR. 

Elhan 

LT EVian Rebar, tiSfr 

Student MOVES insteute htm ihaw w mo vasrne Muia ony 
Graduate School of Operational i Inform a aon Science* 
“ •■ r Smoot 



IPS III 



(XP||£S 

MAR 3 0 20I2 
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f\n5 o»\jL cr. survey mon^c:0^ 


EqsI- study Peinn graDhtc Survf^y 
ID# flast four digits of your telephone #):_ 

1. Did you have any problems seeing the tool clearly’ 

(hard to see) 1 2 3 4 5 (easy to see) 

2. How easy was the tool to understand and apply’ 

1 2 3 4 5 (easy) 

3. Did the tool hinder learning or practice? 

(none) 1 2 3 4 5 (extremely) 

^ lerturesT^*'"'"* training given In the SWOS shiphandling 

(not at all) 1 2 3 4 5 (very much) 

5. How well did tool help you in the SWOS Intro COVE training sessions’ 

(not at all) 1 2 3 4 5 (very much) 

6. What specifically helped you? 

(not at all) 1 2 3 4 5 (very much) 

7. If you had this tool to take with you to the fleet how likely would it be that 
you continue to use it to train or praalce? 

(not at all) 1 2 3 4 5 (often) 

8. How likely would It be that you would recommend this tool to a friend or 
shipmate for training or practice? 

1 2 3 4 5 (everyone) 

9. How likely would it be that you would use this tool to prepare for simulated 
shiphandling evolutions (i^. COVE, Full Mission Bridge NSST)? 

(not at all) 1 2 3 4 5 (often) 

10. How likely would it be that you would you use this tool to prepare for 'live' 
shiphandling evolutions? 

(not at all) 1 2 3 4 5 (often) 

11. Did you feel frustrated while using the tool? If so, please explain. 


UPS IRB 

APPROVED 
OCT 0 7 2011 
EXPIRES 
MAR 3 0 2012 
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12. What recommendations would you give for improvement of the tool or its 
application to training? 


13. What was your opinion of the training tool you used? 


14. What are some things you thought the tool lacked? 


15. Did you experience any problems with the supjriemental information given 
while using the tool? (e.g. "cheat sheets" or worksheets) 


16. Are there any other recommendations you can give (when not actually 

driving a ship) that will help future shi^rlvers train or prartice shiphandling 
skills? 
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The Sea of Simulation 


An Analysis of Game Based 
Shiphandling Simulation Software in 
Support of the Surface Warfare Officer 

Training Continuum ,psi„ 

APPHQVEO 

OCT 07 20tt 
EXPIIES 

http;//movesinst itute.org 


Disclosure 


• This is a research study performed by Naval 
Postgraduate Students. 

• The research is being performed for thesis work 
required in an NPS Master's Degree program. 

• Participation is voluntary and will not have any 
effect on your academic standing. 

• Participation is anonymous. No one in your chain 
of command will know whether you have chosen 
to participate or have chosen not to participate. 

831-656-7582 

http;//movesinstitute.org 
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Background 

• There is no low cost, readily accessible 
shiphandling resource to fill the gap between 
seminar style shipboard training and the 
higher fidelity simulations currently available 
to Naval Officers. 

• COVE / FMB usage restrictive 


Current Training Resources 

• Shipboard / Classroom Seminar 

• Kongsberg NSST Desktop 

• Conning Officer Virtual Environment 

• Full Mission Bridge 

- IMO certified models available 

• Real World Shiphandling 
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ShipSim Extremes 

• Developed by VSTEP 
- Nautis (Task Group level) 

• Not designed for 
training, but lent well to 
task scenarios 

• Robust Mission Editor 
allowed development at 
the evolution level 

• Networked play ability 



Scenarios volunteers will 
participate in 


9/14/2011 


2 practice scenarios and 
2 Task scenarios of 
increasing difficulty 
Focus on core 
competency of getting a 
ship underway and 
maneuvering for a 
subsequent pier landing 
Parallel landing 

90 degree landing with 
obstructions 
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Scenario Design 

• Three days of participation 

• Two days (After normal working hours) 

- 2 sessions of 10 minute practice scenario followed 
by 15 minute Task scenario 

- Task scenario ends once first mooring line is over 
or 15 minutes expires 

— Short break between tasks 

• Third day (after hours on last day of COVE) 

- 45 minute evaluation scenario 

• Post-study online survey 


Hypothesis 

• Students who use game based shiphandling 
simulations to practice tasks covered in 
classroom shiphandling theory, prior to higher 
level simulation use (e.g., Conning Officer 
Virtual Environment (COVE), Full Mission 
Bridge (FMB)), will result in a higher level of 
performance in those tasks than those not 
currently using game based shiphandling 
simulation 
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Proposed Research Study 

• Goal is to get at least 18 participants over 
three sessions 

• Participants will receive test treatments over 
two sessions 

• Research study will be conducted on a not to 
interfere basis with OCS SWO Intro classes. 

• At the end of the normal COVE course of 
instruction a 45 minute evaluated session will 
be held after hours to gather data 


Expected Results 

• We think using simulation prior to COVE will 
maximize effective COVE time. 

- Providing a game based simulation for practiceof 
shiphandling theory could shorten familiarization 
time, make COVE training more immediately effective, 
and help students immerse more readily. 

- Saying conning commands out loud and seeing the 
ship respond will allow quicker memorization and 
result in more beneficial application during higher 
level simulation. 

- Visually identifying navigation buoys, piers, and other 
navigation aids will help student to recognize these 
features in higher level simulation. 
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Possible benefits 

• There is no direct benefit to participants. 

• A tool for students to use for independent Study prior 
to COVE, potentially resulting in reduction in COVE and 
FMB time to acquire proficiency. 

• A tool to be used by Wardrooms to visually rehearse 
evolutions. 

• A tool for officers who have not had recent bridge time 
to maintain proficiency. 

• A training tool for the JO/ CO shipboard training 
continuum. 

• A demonstration tool for CO's to check shiphandling 
acumen or as a gateway toward eligibility for live 
evolutions (direct observation or score reporting). 


Restrictions 

• Correctable 20/20 vision is required 

• Participants must not be colorblind 

• Motion sickness 
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Questions? 

If you are interested in volunteering please contact LT 
Bernard^i^^K^H^fllil^or LT Ethan Reber by 
lunchtime tomorrow. 
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APPENDIX D. CRESST STANDARD SURFACE FORCE 
SHIPHANDLING ASSESSMENT 


A. COSA CRESST SSFSAS 


STANDARD SURFACE FORCESiHIPMAnDLIlia ASSESSMENT EET (RBVO-S MarSOll) 

Rink / NMnt/TaMni_Dalfl::_ 

SliIpL_Enluatfir: 

Evolutlani / Pqs Uih- Itamii 
n C«Mui dK^hdpuuderwiaji 

□ CoATi Ohc shdp durit^j. a DWMrlug eivaUiulau laQZ.Z.Z-DI 

□ Cojui dK£IidpEuarhuir, £d0tiuTy,dr<]uuucJ (34KZ3.1Z) 

□ CfMui iLiulug: au UNilEP approacti |3a^2^.31]^ aldugjslda durlu^ an UNEiEP avaLitdau |3C^3.2 ar 
durli^ ott UNREP breakaway {3ez.Z.32) 

□ Cnnn Ok slidp during a DtuL<]-Ehl|ii lacElicaE DtanauMcrliig exardxas (SOZJZJMif 

□ Dnnn Ok ^p la Huavar au acniali ar slstulaccd. ctan. a^erboard {302 J.5T| 

□ Omui dK fihdp ilirat*^ an aucbarlng e^xiluckin. f303Jl^T]f ar uudcnviiy [Tent anclu^ra^ 

□ Oeber;_ 


Laval 4vf PaFtcHTnancaL QSiilc Q iMannadlaia Q Unauiad fSaaTahh l-Taik^&isandahif^Candlbkirni] 


skill Areaj and Tadu 
{Sea Table 2 EarTask Dascrlpih-Mi) 


UHSAT 

m 

Rcoulren 

iBAproiva'- 

untne 

111 

HCbU 

ScaiLilaHh 

m 

FraDulcui 

f3| 

H/A 

SITUATIONAL AWARENESS (1S%.] 

* EMVl/eMUAMiul Fa-oan 

5- 

o 

B 

14 

iS 


* Ship AifcIvidiA / PlartE. CanlVgiuiadaA 

s 

o 

£ 

ID 

IS 


* CuuH Sloiadeu 

s 

o 

£ 

ID 

IS 


DEOSION MAKING rL5^l 
* AaM«a THerUn andAa 

R 

o 

s 

Ifr 

34 


* aiMrauiutdar jcnaif/BntvgttMiaa 

T 

o 

7 

14 

31 


MANIIJ^IR [60%} 

* MaMluAerSiJatv UALAUlntd 

lO 

a 

ID 

2Q 

SD 


* Rulu of dia Read AppUcailab 

IQ 

o 

ID 

2D 

9D 


* Um arRiiddar^ Pwipiddica^ and Tup 

2± 

o 

25 

5D 

7S 


* AiilUlpailH £l Evuluaw SKI||i 
jraaeanjLvanaii 

IQ 

o 

ID 

2D 

3D 


> Subdard Oiinittundi 

5- 

<t 

B 

14 

IS 


C0MM1JNICATI0N riO%) 

* BRH/LnuntalA. waietaxaam 
«emmijpt|paile« 

ID 

a 

ID 

2Q 

3d 


Tot^ SCORE: 








CMuihaaHi 
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Shiphandliiis SldQ Assessment 

Badf^roond: Devek>pmg a Seaman's Eye and diq>haDdImg profideocy requires an understanding of basic 
maneuvering prindples, developing situation awareness and frequent practice. This assessment tool is 
designed to measure the extent to wtndiBasicIntennediace, and Advanced level mariners hatve perfected 
their shiphandJing sldlls. In aP cases, shiphandling tasks and standards of performance are Ae same frt>m 
Basic to Advanced levels. What distinguisbes performance of beginners from that of experts is die ability to 
perform those same tasks successfully under ever more demanding condiaons. tod is one option 

Commanding Officers mayusetojudp the proficiency of their conning officers Scoring may be done 
manually on paper grade sheets or on a PC tablet with Shiphandling Skill Assessment software installed. 

Directions: 

L On the grade sheet identify the Evolution being evaluated. 

2. From Table 1, (the attached Eccel Spread Sheet] identify die level of performance being et'ahiated (Basic, 

Intermediate. Advanced]. Level of performance is a function of the difficulty of the Conditions (handling 

the ship in challenging environments, among hi^ traffic density, and facing equipment casualties and 
emergencies, etc.]. The tasks and standards are the same from Apprentice throu^ Master, the conditions 
become more demanding with increased levels of perfonnance. Note: In graded trainer/simuUtor scenarios, 
the conditions can be ea^ controlled, but not at sea. At-sea evahiators must apply jud^ent as to the level of 
difficulty or complexity of the conditions to assign the Basiclntermediate, Advanc^ Master level of 
performance based on the prevailing conditions at the time. Not all the indicated conditions in Table 1 will be 
present in an evolutions at sea or in a trainer. 

3. Monitor the conning officer's perfonnance in each ofthe eleven (11] skin tasks listed on the grade sheet to 
determine the skin level achieved, from Unsarisfactoiy to Profici^ and drde the level achieved for each tasL 

Table 2 describes the tasks for standardized interpre t ation. 

a. DNSAT = little to no skiU or knowledge demonstrated 

b. Needs fanpravement = suffidentknowledgeorskiDdemonstratedbutinsufficienttomeetminimum 
esqi>ectations. Additional trainmg and practice required 

c. Meets Standards adequate skin or knowledge demonstrated to perform the task. 

d Proficient = EXCELLENT skill and knowledge demonstrated 

4. Tally ah points awarded 

Wei^itin^ The Shq>handling Assessment is based on evaluation in four (4) uu^ skin areas, each weighted 
according to its relative importance: Situational Awareness 15%^ Decision-making 15S^ Maneuver 60%, and 
Communication 10% 

SldD Levels: Based cm the individual's perfonnance. increasing value is assigned for each of the slrilk hsted in the 
grading table: 0-Unsatisfactory, IX-Needs Improvement 2X-Meets Standards, and 3 X-Proficient 

Score Calculation: Scoring is based on a 300 point scale (maximum number of points at'ailable). The oxgall score 
is calculated by adding the individual task point values for each of the four (4] skill areas under the UNSAT, Needs 
Improvement Meets Standards, and Profirient columns. These benchinaiks assume aD 11 skill tasks on the 

assessment sheet are graded If one or more are not appbcable and marked H/A", the final grade must be 

adiusted accordingly and the grade calculated based on the total points available. Note: Shiphandling software 
automatically calculates the conning officer's grade as performance is entered 

Aatnmatic Failing Grade; Alhsion with an object (pier, buoy], coUisicm with another vessel running aground 
violating the Rules ofthe Road or accumulating one or more grades of UNSAT on any task will result in an 
automatic failure for the event 

Performance Benchmarks Based on the 300 point criteria, the benchmarks for individual performance are as 
follows. The minimnm parang score is 180i 

Proficient: 2S0 - 300 
Meets Standards: 180 - 249 
Needs hnprovemenfi 101 -179 
Unsatisfactory: 100 or Below 


126 





APPENDIX E. RAW DEMOGRAPHIC SURVEY DATA BY 

QUESTION 


Question 1 


Do you play video games on computers (e.g., PC/MAC)? 

Participant # 

Participant Response 

2831 

N/A 

2121 

No 

3536 

Sometimes 

9758 

No 

6562 

1 have in the past 

2369 

No 

2289 

No 

5194 

Yes. PC and MAC 

2233 

Console and PC 

7093 

Yes 

2998 

Not really 


Question 2 


Have you ever played simulation video games on your computer? 

Participant # 

Participant Response 

2831 

N/A 

2121 

No 

3536 

Yes 

9758 

No 

6562 

No 

2369 

Yes 

2289 

Yes 

5194 

Yes 

2233 

No 

7093 

Yes 

2998 

Yes 
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Question 3 


If the answer to the previous question is “Yes,” have any of the computer 
simulations been related to naval or commercial shiphandling? 

Participant # 

Participant Response 

2831 

N/A 

2121 

N/A 

3536 

No 

9758 

N/A 

6562 

N/A 

2369 

No 

2289 

No 

5194 

No 

2233 

N/A 

7093 

No 

2998 

No 


Question 4 


If you have played video games on your computer as described in question 3, 
what amount of time would you say you have contributed to the game in last six 
months? (e.g., hours, days, weeks, months, etc.) 

Participant # 

Participant Response 

2831 

N/A 

2121 

N/A 

3536 

N/A 

9758 

N/A 

6562 

N/A 

2369 

N/A 

2289 

N/A 

5194 

N/A 

2233 

N/A 

7093 

N/A 

2998 

N/A 
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Question 5 


What amount of time have you spent playing simulations other than those related 
to question 3? (e.g., hours, days, weeks, months, etc.) 

Participant # 

Participant Response 

2831 

N/A 

2121 

Zero 

3536 

Played MS Flight Simulator for about 2 months, 2-3 hours every 
day after class due to my job as a student researcher for NASA. 

9758 

N/A 

6562 

N/A 

2369 

None 

2289 

N/A 

5194 

Months 

2233 

None 

7093 

Very little, hours at most 

2998 

Very little 


Question 6 


What amount of time have you spent playing any video game on a computer in 
the last 6 months (non-console, Xbox, PS3)? (e.g., hours, days, weeks, months, 
etc.) 

Participant # 

Participant Response 

2831 

Zero 

2121 

Zero 

3536 

2 hours 

9758 

Zero 

6562 

Zero 

2369 

6 hours 

2289 

Zero 

5194 

Week or so 

2233 

36 hours 

7093 

3 hours per day before QCS 

2998 

Zero 
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Question 7 


What level of shiphandling experience do you have? E.g., recreational, military, 
commercial (Please include shipboard qualifications or any commercial 
simulation time like CQVE or Full Mission Bridge) 

Participant # 

Participant Response 

2831 

None 

2121 

Zero 

3536 

None 

9758 

None 

6562 

Recreational. Weekends on the lake or waterway in smaller 
power boats 

2369 

None 

2289 

None 

5194 

None 

2233 

None 

7093 

None 

2998 

Very Little 


Question 8 


Do you have sailing experience? 

Participant # 

Participant Response 

2831 

No 

2121 

Zero 

3536 

Went sailing for the first time yesterday 
[Would have been 11Qct11] 

9758 

No 

6562 

No 

2369 

No 

2289 

No 

5194 

No 

2233 

No 

7093 

No 

2998 

Very Little 
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APPENDIX F. JMP RAW COVE DATA BY PARTICIPANT 


Participant ID 

Margins of 
Safety 
Maintained 

Use of Rudder, 
Propulsion, and 
Tugs 

Anticipates & Evaliiates 
Ship Reponsiveness 

Standard Commands 

Standardized Score 

1 

20 

25 

10 

10 

130 

2 

10 

50 

10 

15 

170 

3 

20 

50 

20 

10 

200 

4 

20 

25 

10 

10 

130 

5 

10 

50 

10 

10 

160 

6 

20 

50 

20 

15 

210 

7 

20 

50 

10 

10 

180 

8 

10 

50 

10 

10 

160 

9 

20 

50 

10 

10 

180 

10 

20 

50 

10 

10 

180 

11 

20 

50 

10 

10 

180 
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APPENDIX G. COGNITIVE TASK ANALYSIS (CTA) (FROM 

GRASSI, 2000) 


1. HIERARCHICAL TASK ANALYSIS (HTA) 

a. HTA for Getting Ship Underway from a Pier 

Goals: 

Ensure Ship is Ready to get underway 

• Assess environmentals and ship surroundings 

• Visually assess ships distance to nearest obstructions 

Complete Clearing the Pier 

• Receive order from CO to get underway 

• Complete assessment of environmental factors 

• Complete taking in all lines 

• Swing stern away from pier 

• Swing bow away from pier 

• Complete assessment of ships movement/ position 

Complete Exiting Pier Area (problem in this section of Grassi thesis) 

• Ensure stern is clear of pier 

• Ensure bow is clear of pier 

• Ensure Bow direction matches heading of intended course 

• Determine course to steer 

• Order engines ahead at a 1/3 bell 

• Order helmsman to steer ordered course 

• Assess response of ship 

• Ensure bow direction matches heading of intended course 
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Complete Entering the Channel 

• Complete turn into channel 

• Ensure ship is on correct heading 

• Order engines ahead at a 2/3 bell 

• Monitor intended course for surface contacts 

b. HTA for Mooring Ship to a Pier 

Goals: 

Enter pier area 

• Safely complete harbor transit 

• Reduce ships speed 

Complete pier approach phase 

• Maneuver ship to proper approach angle with pier 

• Assess environmentals and ship surroundings 

• Visually assess ships distance to nearest obstructions 

• Complete assessment of ships movement/ position 

• Reduce speed to bare steerage way 

• Assess environmentals and ship surroundings 

Complete positioning and stopping 

• Approach within 100 feet of pier 

• Maneuver ship so mooring side is parallel to pier 

• Slow to less than 1 knot Speed Over Ground 

• Order over all lines 

Complete maneuvering ship against pier phase 

• Verify ship properly aligned with pier 

• Monitor ships position and distance from pier 

• Make adjustments to ships position 
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• Move in ship against pier 

• Monitor ships position and distance from pier 

• Make adjustments to ships position 

• Verify ship properly against pier 


2. CRITICAL CUE INVENTORY (CCI) 

a. CCI for Getting Ship Underway and Mooring to a Pier 


Assess enviromentals and ship surroundings 

• State of water in channel 

• Buoys 

• Wind Indicator 

Visually assess ships distance to nearest obstructions 

• Separation between bow and pier 

• Separation between stern and pier 

• Distance to surrounding obstructions 

Complete taking in all lines 

• Order take in all mooring lines 

Determine if engine order was executed 

• Sound of engines accelerating 

• Hear helmsman acknowledgement 

Assess response of ship 

• Change in separation between ship and pier 

• Rate of swing of ships bow or stern 
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Assessment of Ships movement and position 

• Change in separation between ship and pier 

• Rate of swing of ships bow or stern 

Measuring distance between ship and pier 

• Open space between ships stern and pier 

• Open space between ships bow and pier 

• Open space between ships amidships and pier 

Monitor intended course for surface contacts 

• Scan horizon for other surface contacts 

Verify ship aligned with pier 

• Bridge wing is aligned with second bollard on pier 
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APPENDIX H. CRESST SHIPHANDLING TASK DESCRIPTION 

AND GRADING CRITERIA 
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SMN Area Needs Improvement Meets Standards Proficient 


Figure 33. 
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Figure 34. 
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APPENDIX I. CRESST SHIPHANDLING TASKS, STANDARDS, 

AND CONDITIONS 



Figure 37. CRESST Tasks, Standards, and Conditions for Conn the ship underway 

from a pier 
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APPENDIX J. SHIP SIMULATOR EXTREMES TASK SCENARIO 
USAGE, DESIGN PHILOSOPHY, AND PERIPHERAL SETUP 


A. SOFTWARE INSTALLATION AND ACCESS TO MISSION EDITOR 

1. The Ship Simulator Extreme software is available for purchase at 
http://www.shipsim.com/products/shipsimulatorextremes and can be downloaded 
directly from the site or ordered in hard copy. Verify that the software is no earlier 
than v1.4 (build 1086). If this is not the case, the appropriate software patch is 
available at http://www.shipsim.com/downloads/updates . 

2. Once the software had been installed on your Windows PC or laptop, 
open the program by clicking the left button of your mouse twice over the Ship 
Simulator Extremes icon on your Desktop or via the following path Start/AII 
Programs/Ship Simulator Extremes/Ship Simulator Extremes. The program will 
go through its normal startup routine and then present the Main Menu screen 
(Figure 38). 
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Figure 38. Ship Simulator Extremes Main Menu Screen 
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3. You will need to provide a name for your profile before you are allowed 
to proceed any further. This can be any alphanumeric sequence. 

4. Left-click on the Mission Editor icon found in the lower left corner of the 
Main Menu Screen. This will bring you to the Mission Editor GUI (Figure 39). It is 
via the Mission Editor that task scenarios can be created. A helpful resource to 
assist in mission development, the Mission Editor Guide, is available through the 
following path Start/AII Programs/Ship Simulator Extremes/Mission Editor Guide. 



Figure 39. Ship Simulator Extremes Mission Editor GUI 

B. DOWNLOADING AND INSTALLING THE TASK SCENARIO MISSION 
FILES 

The two files that comprise a task scenario are in XML and a EN file 
format. The latter file type allows the game and scenario instructions to display in 
the English language. To download and install the task scenario mission files, 
perform the following steps: 
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1. In your Internet browser, visit 

http://www.movesinstitute.orq/ed student res.html and look for the hyperlink for 
the downloadable thesis missions under the Sea of Simulation thesis description. 

2. Download the Zip file ThesisMissions.zip to your machine. 

3 Extract the folder and cut and paste the eight files into the following 
path Documents/ShipSimExtremes Userdata/Missions. 

4. Start or restart Ship Simulator Extremes for the scenario files to be 
recognized by the program. 

5. The missions can now be accessed by left clicking “Play” then 
“Single Mission.” 

C. SCENARIO ONE DESIGN 

Task scenario one was designed to support familiarizing the student 
participant with the controls of the WHEC ship model as well as the task 
environment they would be operating in during scenarios two and four. Figure 40 
displays the starting point of the Cutter model in the Mission Editor. 



Figure 40. Cutter Starting Position Mission One 
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The logic chain implemented in this scenario was relatively simple and 
required a 15-minute countdown clock to begin counting down at the initiation of 
the scenario and to end the mission once the time had expired. This was 
accomplished using one Start Event node, three State nodes, and three trigger 
nodes. The logic chain is displayed in Figure 41. The 
StartStudentObjectiveNodel initiated the countdown. ClearedStudentObjectivel 
listened for the timer to end and ended the scenario once this state was 
achieved. 



Figure 41. Task Scenario One Logic Editor Logic Chain 

D. SCENARIO TWO DESIGN 

Task scenario two was designed to present the student participant with 
the compound problem of getting the WFIEC ship model underway from a pier, 
steaming down the river, making an approach on a pier, and successfully 
mooring to the pier. Environmental variables were disabled in scenario two and 
four to present a similar operating environment to that presented in the COVE 
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training and evaluation sessions. Figure 42 displays the starting point of the 
Cutter model in the Mission Editor. 



Figure 42. Cutter Starting Position Mission Two 

In order to ensure the participant was not overwhelmed with instructions 
related to their maneuvering task, we split the information displayed to them to 
the beginning of the scenario and the middle, relative to distance and not time. At 
the midway point, the pier where the student would be tasked to moor would be 
visible to them. Two bridges previously obscured this pier. At this point, they 
would pass through an invisible waypoint, called Waypointi SphereAreaEntity 
(Fig 43), which would trigger the display of their final maneuvering instructions. 
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Figure 43. Mission Two Further Directions Trigger Waypoint 


Figure 44 displays the six bollard-mooring configuration at the destination 
pier. The arrangement on the starting pier is the same. A trigger was set for the 
third bollard from the front, named AfterSpringBollardEndOl, which ended the 
scenario once mooring line number two was connected. The bollard size was 
increased to a value of eight to ensure visibility comparable to that of a standard 
bollard on a shipping pier. 
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Figure 44. Mission Two End of Mission Mooring Area 

The logic chain implemented in this scenario was accomplished using one 
Start Event node, five State nodes, and four trigger nodes. The logic chain is 
displayed in Figure 45. The Initialize node initiated placed the scenario into an 
active state and cleared a bug that initiated high winds at the start of the 
scenario, despite settings for winds of speed zero. StartStudentObjectivel 
displayed the “Captain’s Orders” on the screen and activated the waypoint 
sphere previously discussed. ClearedStudentObjectivel listened for the Cutter to 
pass through the waypoint sphere and activated a message directing the student 
to moor to the pier ahead once this state was achieved. The final trigger, 
Triggerl, ended the scenario once mooring line number two was connected to 
the entity AfterSpringBollardEndOl. The student could only order this if proximity 
to the pier was less than 100 feet and the ship’s speed was under one knot of 
headway or sternway 
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Figure 45. Task Scenario Two Logic Editor Logic Chain 

E. SCENARIO THREE DESIGN 

Task scenario three was designed to support the student in practicing with 
the controls of the WHEC ship model but started the student in a different area of 
the task environment and time of day than scenario one. The change of location, 
still within the New York map, and time of day was done to prevent the student 
from becoming complacent from a stale environment and was chosen from the 
research team’s experiences in a classroom pilot study at Naval Postgraduate 
School. Figure 46 displays the starting point of the Cutter model in the Mission 
Editor. 
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Figure 46. Cutter Starting Position Mission Three 

The logic chain implemented in this scenario was the same as that 
utilized in task scenario one and is displayed in Figure 47. The countdown timer 
value was set for 15 minutes. 
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Figure 47. Task Scenario Three Logic Editor Logic Chain 


F. SCENARIO FOUR DESIGN 

Task scenario two was designed to present the student participant with 
the compound problem of getting the WHEC ship model underway from a pier, 
steaming down the river, making a 90-degree approach turn on a pier, and 
successfully mooring to the pier with obstructions in all directions. 
Environmental variables were disabled in scenario four to present a similar 
operating environment to that presented in the COVE training and evaluation 
sessions. Figure 48 displays the starting point of the Cutter model in the Mission 
Editor. The starting point for mission four is the same as the ending point from 
mission two. 
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Figure 48. Cutter Starting Position Mission Four 


Figure 49 displays the “navy pier” where the participant would attempt to 
moor. This pier arrangement is similar to that which could be seen on an actual 
naval pier or in the COVE. The static ships were required to be moored with lines 
and anchored as well to prevent a venture effect between the moving Cutter and 
the static warship models. The “navy pier” was clearly visible from the starting 
point of the mission and required no additional instructions beyond the initial 
“Captain’s Orders,” thus eliminating the requirement of additional triggers. 
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Figure 49. Mission Four Starboard Turn to Navy Pier 


Figure 50 displays the six bollard-mooring configuration at the destination 
pier. The arrangement on the starting pier is the same. A trigger was set for the 
third bollard from the front, named AfterSpringBollardEndOl, which ended the 
scenario once mooring line number two was connected. The bollard size was 
increased to a value of eight to ensure visibility comparable to that of a standard 
bollard on a shipping pier. 
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Figure 50. Mission Four End of Mission Mooring Area 


The logic chain implemented in this scenario was accomplished using one 
Start Event node, three State nodes, and three trigger nodes. The logic chain is 
displayed in Figure 51. The Initialize node initiated placed the scenario into an 
active state and cleared a bug that initiated high winds at the start of the 
scenario, despite settings for winds of speed zero. StartStudentObjectivel 
displayed the “Captain’s Orders” on the screen. Triggerl ended the scenario 
once mooring line number two was connected to the entity 
AfterSpringBollardEndOl. The student could only order this if proximity to the pier 
was less than 100 feet and the ship’s speed was under one knot of headway or 
sternway 
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Figure 51. Task Scenario Four Logic Editor Logic Chain 

G. PERIPHERAL SETUP: SHIP CONSOLE 

1. The research team used a Ship Console by VR Insight (Fig 52) for 
simulated helmsman control inputs as directed by the student conning officer. 



Figure 52. Ship Console by VR Insight 

2. The Ship Console was simple to program and was well integrated with 
the Windows Operating System. Before programming functions to the Ship 
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Console in Ship Simulator Extremes, you must calibrate the tiller and throttles in 
Windows. To perform the calibration, plug the USB output from the Ship Console 
into an open USB port on your machine. The Windows Operating System will 
recognize the addition of a peripheral. Go to “Control Panel” then “Game 
Controllers” and verify that the Ship Console has been recognized as a USB pad. 
Select “Properties” then “Setting” and then “Calibration.” Run the “Calibration 
Wizard” and click “Next” until you see “X Rotation.” Move the tiller to the left 
maximum and then to the right maximum. Click “Next” until you see “Rudder.” 
Move the left lever to the forward maximum and then to the rearward maximum. 
Click “Next” until you see “Throttle.” Move the right lever to the forward maximum 
and then to the rearward maximum. Click “Next” to finish and exit the calibration 
process. 

3. After calibrating the Ship Console you can then map the keys, tiller, and 
throttles in Ship Simulator Extremes. After starting Ship Simulator Extremes, click 
“Options” then “Controls.” Verify that the “Precision Steering” option is 
unchecked. From the drop down menu, choose “Interface” and update in 
accordance with Table 12. 


Interface 

Input 2 

Show / Hide Panels 

Joy 1 Button 3 

Select Camera 1 

Joy 1 Button 16 

Select Camera 2 

Joy 1 Button 17 

Select Camera 3 

Joy 1 Button 18 

Pause 

Joy 1 Button 13 

Restart Mission 

Joy 1 Button 12 

Show / Hide Controls 

Joy 1 Button 5 

Chart Zoom In 

Joy 1 Button 10 

Chart Zoom Out 

Joy 1 Button 11 


Table 12. Interface Key Bindings 

4. Next, choose “Ship Controls” from the drop down menu and update in 
accordance with Table 13. 
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Ship Controls 

Input 2 

Engine 1 Increase Throttle 

Joy 1 Zrot Pos 

Engine 1 Decrease Throttie 

Joy 1 Zrot Neg 

Engine 1 Reset Throttie 

Joy 1 Button 7 

Engine 2 Increase Throttle 

Joy 1 Slider 1 Pos 

Engine 2 Decrease Throttie 

Joy 1 Siider 1 Neg 

Engine 2 Reset Throttie 

Joy 1 Button 8 

Rudder 1+2 port / Left 

Joy 1 XRot Pos 

Rudder 1+2 starboard / Right 

Joy 1 XRot Neg 

Rudder 1+2 reset 

Joy 1 Button 20 


Table 13. Ship Controls Key Bindings 

5. Finally, choose “Camera Controls” from the drop down menu and 
update in accordance with Table 14. 


Camera Controis 

Input 2 

Camera Rotate Left 

Joy 1 POV16 

earner Rotate Right 

Joy 1 POV12 

Camera Rotate Up 

Joy 1 POV 10 

Camera Rotate Down 

Joy 1 POV 14 

Camera Zoom In 

Joy 1 Button 1 

Camera Zoom Out 

Joy 1 Button 9 

Camera Reset 

Joy 1 Button 2 


Table 14. Camera Controls Key Bindings 

H. PERIPHERAL SETUP: WIRELESS 3 BUTTON USB MOUSE 

The mouse, Figure 53, required no additional setup due to Windows Plug 
and Play functionality. The students used the left mouse button to access the 
harbor chart built into the Ship Simulator Extremes task scenario. The right 
button, by depressing it and dragging the mouse, offered them rotational control 
of the camera to maneuver around the ship for optimal viewpoint. The scroll 
button allowed the students to zoom the camera in and out from the WFIEC 
model as needed. 
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Figure 53. Microsoft Wireless Mobile Mouse 3000 
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